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Evidence Contestation 


This book examines the practices of contesting evidence in democrati- 
cally constituted knowledge societies. It provides a multifaceted view of 
the processes and conditions of evidence criticism and how they deter- 
mine the dynamics of de- and re-stabilization of evidence. 

Evidence is an essential resource for establishing claims of validity, 
resolving conflicts, and legitimizing decisions. In recent times, however, 
evidence is being contested with increasing frequency. Such contesta- 
tions vary in form and severity — from questioning the interpretation 
of data or the methodological soundness of studies to accusations of 
evidence fabrication. The contributors to this volume explore which 
actors, for what reasons and to what effect, question evidence in fields 
such as the biological, environmental and health sciences. In addition to 
actors inside academia, they examine the roles of various other players, 
including citizen scientists, counter-experts, journalists, patients, con- 
sumers and activists. The contributors tackle questions of how disagree- 
ments are framed and how they are used to promote vested interests. 
By drawing on methodological and theoretical approaches from a wide 
range of fields, this book provides a much-needed perspective on how 
evidence criticism influences the development and state of knowledge 
societies and their political condition. 
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Introduction 


Evidence Critique and Contestation as 
a Challenge in Academia and Society 


Karin Zachmann, Saana Jukola, Olga Sparschuh, 
and Mariacarla Gadebusch Bondio 


On April 4, 2022, the Intergovernmental Panel on Climate Change 
(IPCC) published a report, stating that the goal of limiting the average 
global temperature rise to 1.5°C above pre-industrial levels is turning 
out to be impossible. Without immediate remedial action and a consid- 
erable transformation of our consumerist way of life, we cannot hope to 
stop average temperatures from rising to levels that threaten to disrupt 
the climate system on a global scale. Why is it that we have not been 
able to counter this deeply worrying trend sooner, despite the numerous 
concerned statements issued by individual scientists, activists and sci- 
entific associations? Many blame think tanks, whose researchers have 
questioned climate science evidence for years and raised doubts about 
the validity of claims about the looming threat. Those critical of estab- 
lished climate science, in contrast, often argue that they are interested 
in evidence and would be willing to accept the disturbing messages were 
there better evidence to support it.! And then there are the many who, in 
the face of ambiguous evidence claims, persist in doing nothing. 

The debate on climate change, climate research and its use in inform- 
ing policy-making is just one example of the many hotly contested evi- 
dence-related issues of the present day which form the basis of this book. 
Particularly in moments of crisis, key questions acquire new urgency: 
What is good evidence for practical decision-making? What are substan- 
tive grounds for questioning certain pieces of evidence? Who has the 
right — or responsibility - to participate in debates about evidence? How 
do contesters of evidence proceed? What impact do such contestations 
have in a societal context in which evidence is elevated to the status of a 
resource? The authors of the book seek to answer these questions.’ 

Before exploring evidence contestation and its impact on society in 
more detail, we need to establish the premises of our research approach 
to evidence. The hypothesis of the “paradox of knowledge societies”, 
which we outline in the following section, provides the starting point 
for anchoring our questions. We continue by discussing both evidence 
and its contestation as disputed concepts themselves. Glancing over the 
perspectives on evidence criticism in the humanities and social sciences 
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reveals the lines of thinking we rely on. We then look at evidence critique 
as an academic pursuit and discuss what distinguishes it in contrast to 
contestations and conflicts that unfold when evidence is put to use. 
Finally, a passage through the contributions of this book helps us assess 
how the actors in the case studies presented deal with dissent and thereby 
act on societal conflicts. 


The Paradox of Knowledge Societies 


A basic feature of contemporary knowledge societies is the paradox that, 
on the one hand, they are fundamentally dependent on science and sci- 
entific expertise, which are becoming increasingly important as a basis 
for decision-making. On the other hand, scientific knowledge is con- 
tinually questioned and expertise is increasingly controversial.’ Critical 
discussions are no longer confined within the walls of academia but have 
spread to society at large. Ever wider circles now question the valid- 
ity of scientifically generated knowledge.* Recently, we have witnessed 
not only ever more nuanced disagreement between experts and their lay 
audiences but also outright science denialism.° 

Depending on the context of the dispute, evidence contestations vary 
in form and severity. To gain the widest possible insight into the prac- 
tices of evidence critique, we have chosen a broad concept of “evidence 
contestation”; one which encompasses forms of traditional systematic 
evidence critique and review within universities and academia as well as 
radical questioning of the legitimacy of established methods of evidence 
generation and entire fields of inquiry inside and outside of the academic 
realm. This extended conception of the term allows us to avoid a strict 
separation of contexts and actors, and thus to see connections and entan- 
glements between critique and contestations in different societal spheres. 

The prime contemporary example of the interaction between aca- 
demia, media and various publics and actors often operating in several 
of these domains was of course the COVID-19 pandemic. Due to the 
urgency of the situation, traditional scientific peer review processes for 
quality control were dispensed with. Scientists repeatedly corrected their 
positions, as did decision makers in politics. Evidence — or its quality 
level - was contested from the outside, by dissatisfied citizens, and from 
within, by scientists. Certain groups even labeled the COVID-19 pan- 
demic and related research a hoax.® 

In the wake of this, some long-standing certainties seem no longer 
to hold true. Previously common, and in some fields institutionalized, 
evidence practices no longer guarantee credibility or acceptance among 
the general public. Trust in scientific expertise and even science in gen- 
eral appears to be in jeopardy. Given the role that scientific knowledge 
plays in public decision-making today, such contestations of evidence 
may threaten societal cohesion by destroying the basis for science-based 
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agreements and governance.’ But at the same time, the very questioning 
of established evidence by a variety of new actors, who also demand a 
say in key issues, can challenge traditional beliefs in a productive way. It 
may lead not only to the production of diverse evidence, but also to new 
compromises, much in the same way that evidence critique has often 
yielded fruitful results within academia. What emerges from the contri- 
butions to this book are the often positive outcomes of leading scientific 
evidence being challenged, allowing, to varying degrees, for a broader 
inclusion of other perspectives and new knowledge contributions from 
laypersons or marginalized groups. If “lay deference to a consensus of 
experts” is no longer the way knowledge in society is accepted,’ this 
entails a much-needed widening of the zone of criticism and a democra- 
tization of critique. 

Even though these developments have gathered pace in recent years, 
they are not entirely new. Processes of evidence destabilization have 
raised awareness of the vital importance of evidence in society and pro- 
voked increased efforts to restabilize evidence. At the same time, how- 
ever, the provisional and contingent nature of evidence has become more 
prominent. This revolution in our attitudes to and understanding of evi- 
dence practices can be traced back to the 1970s, when the Post-World 
War II optimism regarding the prospects of ongoing prosperity - hith- 
erto taken for granted — began to atrophy, giving rise to uncertainty and 
increasing ignorance as ineluctable side-effects of the advances in science 
and technology. The sociologist Ulrich Beck and colleagues identified in 
this transition into what they saw as a second, reflective modern era, the 
so-called paradox of late modern knowledge societies.? With ever more 
evidence and knowledge becoming available, criticism and contestation 
inevitably increased too. Dealing with dissent became the normal state 
of affairs. The resulting dynamics strongly determine the way in which 
societies decide on key issues in the late 20' and early 21° centuries; 
how they deal with sustainability, environmentalism and technological 
safety; participation of citizens, patients and consumers; food security; 
media communication; increasing prevalence of non-communicable dis- 
eases and other health problems; or medical safety and interventions. 

Reviewing different fields and situations in which science and scientific 
knowledge have been contested, the contributors to this book analyze 
the processes of destabilization of evidence. They seek to identify the 
drivers and actors involved and ask not just about the consequences but 
also about the counterforces involved in such destabilizations. By draw- 
ing on methodological and theoretical approaches from history, sociol- 
ogy, philosophy, science and technology studies (STS), communication 
science and consumer science, the contributions examine, from a variety 
of perspectives, the matrix in which the certainty of evidence is either 
contested or ratified. Understanding the practices of contesting evidence 
illuminates how actors engage with contemporary knowledge society. 


4 Karin Zachmann et al. 


The insights gathered here will help us understand how knowledge soci- 
eties attune to the provisional and contingent nature of evidence. 


Evidence and Its Contestation as Disputed Concepts 


“Evidence” is a widely used term. Lawyers, scientists and politicians call 
for evidence, as indeed do laypersons. What exactly evidence means may 
diverge significantly. However, common to the diverse situations in which 
the term is used is that it signifies something that is appealed to when we 
want to convince others to accept or reject a claim: As Thomas Kelly puts 
it, “evidence, whatever else it is, is the kind of thing which can make a dif- 
ference to what one is justified in believing or (what is often, but not always, 
taken to be the same thing) what it is reasonable for one to believe”.'° It 
should be noted that the meaning of the term varies between languages. 
For example, the meaning assigned to evidence in English differs subtly 
from that of the German word Evidenz. While the English term has a nar- 
rower meaning of “one or more reasons for believing that something is or 
is not true”,!! Evidenz also means “immediate and complete insight, clar- 
ity, certainty” (unmittelbare und vollständige Einsichtigkeit, Deutlichkeit, 
Gewissheit).!? According to Immanuel Kant, evidence is therefore pre- 
suppositionless insight or “demonstrative certainty” (anschauliche 
Gewissheit), an insight without methodological mediation." Inconsistency 
and fluctuations in the usage of the concept of evidence are mainly due to 
the fact that evidence is understood and used both as a subjective form of 
truth recognition (seeing, recognizing a fact as evident) and as an objective 
form of truth discovery (evidence as showing, manifesting a fact). 
Depending on the context then, what is taken to be evidence varies. 
Evidence can refer, for example, to an observation, a physical object, a 
heard statement or research findings. In everyday life, we often interpret 
an observed state of affairs as evidence for believing that something is the 
case. The fact that I cannot see Mary’s jacket hanging on the rack serves 
as evidence for my belief that she has already left the office for the day. In 
the context of a forensic investigation, a single physical object found at 
the crime scene, say a bullet, a bloodstain or a hair, can provide the deci- 
sive piece of evidence that helps to solve the case. Journalists interview 
sources to collect evidence to support an account of the events they wish 
to report on. And scientific research can provide us with results that 
either increase or decrease our belief that, for example, a treatment for 
a disease is really working, or that a chemical is environmentally safe.'* 
Scientific disciplines have their own criteria and assumptions about 
what serves as sufficient or adequate evidence to falsify or support a 
particular hypothesis. Some, such as anthropology, rely on observa- 
tions, yet others base their findings predominantly on archival mate- 
rial, as historians do. In medicine, clinical trials have for many decades 
been of great importance and occupy a high position in the hierarchy of 
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evidence-based medicine (EBM); however, the limitations of randomi- 
zation in large-scale clinical trials that exclude confounding variability 
are now well known. As a result, there is increasing talk of reality-based 
evidence, evidence that is less perfectly generated but arises in the real 
world in which patients live. 

But even within disciplines, there are differences in the production of 
what counts as reliable evidence. For example, different fields of biomed- 
icine pose diverse questions concerning the biological bases of diseases, 
their frequency in distinct populations and the effectiveness of treatment 
and prevention methods. In order to find answers to these questions, 
various methods of producing evidence are used: While laboratory stud- 
ies are useful for learning more about the etiology of a disease, they are 
less fruitful when a researcher tries to determine the prevalence of the 
disease in a given population.'¢ 

In recent years, the concept of evidence has become particularly 
central through the calls for evidence-based practice, that is, practical 
decision-making based on the best available evidence.!” Even though 
there currently are different forms of evidence-based practice, e.g. 
evidence-based policy (EBP), evidence-based nursing, evidence-based 
pedagogy and many others, this framework for decision-making orig- 
inates from the context of clinical medicine.'® Since the 1990s, EBM 
has become a movement aimed at improving the treatment of patients 
by basing it on best possible evidence.'? A central element of EBM is the 
hierarchy of evidence that ranks different types of evidence according 
to their assumed strength. In particular, randomized controlled trials 
(RCTs) are believed to provide irrefutable evidence. The tenets of EBM, 
especially the emblematic emphasis put on RCTs, have since spread to 
other fields. Proponents of EBP, for example, hold that public policy 
should wherever possible be based on RCTs or other experimental evi- 
dence.?? Such a constricted understanding of evidence has been both 
rigidified on the one hand and slightly diversified on the other. When the 
burgeoning call for evidence gave rise to national and international insti- 
tutions, such as the Cochrane Collaboration or the Evidence for Policy 
and Practice Information and Co-ordinating Centre (EPPI) at University 
College London, these organizations institutionalized a second-order 
knowledge production. By conducting systematic reviews of scientific 
studies and research papers, they either subscribed to the narrow con- 
cept of RCT-based evidence or remained more open and included results 
from differently designed studies.?! Either way, the practice of generat- 
ing evidence through systematic review has a power dimension, author- 
izing certain types of evidence and knowledge at the expense of others. 

In fact, such procedures of systematic review and weighting of evi- 
dence according to certain rules are part and parcel of a society’s politics 
of evidence, which can be interpreted with the help of Michel Foucault’s 
concept of a regime of truth. Foucault understands truth as “the ensemble 
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of rules according to which true and false are separated and specific 
effects of power attached to the true”.?? Analogously, an evidence regime 
consists of procedures that distinguish what counts as evidence from 
what does not and what privileges the former at the expense of the lat- 
ter. The power effect attached to evidence lies in its potential to justify 
decisions and to enable action in democratically constituted knowledge 
societies. Thus, whatever it is that counts as evidence in a certain con- 
text and moment, it may lend power to those who successfully claim it. 
Because of this, the contestation of evidence is not only an integral part 
of a society’s evidence regime, but also a form of counter-power. Within 
Foucault’s theory of power, the political art of resistance, the art of “not 
being governed”, is both a gesture of determinedly rejecting unjust laws 
and the more general art of resisting all processes that shape our subjec- 
tivities in accordance with a given “dispositive”, or a regime of power.” 
This would include processes of knowledge creation and evidence pro- 
duction. In their reading of Foucault’s concept of critique, Judith Butler 
underlines its virtue-ethical and epistemic function: “Significantly, for 
Foucault, this exposure of the limit of the epistemological field is linked 
with the practice of virtue, as if virtue is counter to regulation and order, 
as if virtue itself is to be found in the risking of established order”.** 

That the concept of evidence and its critique are not clear-cut and 
unambiguous is mirrored in the contributions to this book. The contrib- 
utors charge the term with diverse meanings, ranging from single data 
and observations to whole studies or systematic reviews of such studies. 
Some go even further and interpret evidence as any result of epistemic 
practices — both academic and extra-academic - which can be deployed to 
work as justifications for a belief that is claimed or a decision to be taken. 

Despite all its ambiguity, evidence has become the most important 
resource in democratically constituted societies, premised on the under- 
standing of “reason as a capacity to explain and to justify”.”> Being able 
to justify our views through persuasion by reason and appeal to evi- 
dence distinguishes us as members of a democratic polity and underpins 
the liberal democratic principle of treating each other with equal respect. 
The rising mobilization of evidence as a means of persuasion, however, 
exposes it to increased contestation. The arenas of these contestations 
are as manifold as the actors involved. A closer look at these arenas, 
actors and practices of evidence contestation can help to understand 
its dynamics and its societal effects. 


Perspectives on Evidence and Criticism in 
the Humanities and Social Sciences 


Evidence and its uses have been topics of scholarship for decades.?° The 
phenomenon of evidence criticism has so far largely been investigated in 
terms of the critique of science. In the 1970s, at the very moment when 
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the fundamental dependence of modern societies on science became a 
matter of concern, and gave rise to the concept of the knowledge society, 
critique and contestation of science was taken up as a subject of inquiry 
too. Scholars, who in one way or another participated in the newly emer- 
gent counter-movements in the sciences, reflected on this development 
and sought to understand its origins, patterns and consequences.” They 
traced the critical traditions back to early 19P-century Romanticism and 
investigated the different forms of critique from within and from the 
outside of science. An important insight from this strand of scholarship 
was the ambiguity and malleability of science criticism. Whether such 
criticism was considered to be pseudo-science, anti-science or frontier- 
science could change over time.?® Also around this period, research 
into controversies in the sciences began. Here, the goal was to better 
understand how scientific controversies were entangled with politics and 
ethics, and what this entanglement meant for scientific reasoning and 
for the authority of science. For example, sociologist Dorothy Nelkin, 
an established authority in the study of controversies, provided grand 
overviews and interpretations of the development and typologies of 
scientific disputes.?? 

Since the 1970s, reflective social scientists and STS scholars in par- 
ticular have not only studied science criticism but also contributed to 
the questioning of scientific evidence themselves. Many studies have 
criticized the sciences for being prone to a naive belief in positivistic 
claims and decontextualized facts.*° The social constructivists have bus- 
ied themselves in enlightening both their colleagues in science and the 
public at large that all facts are man-made things charged with values, 
and that scientific certainty is a chimera. The extent to which scientists 
on the receiving end felt attacked was evident in the declaration of the 
so-called science wars.*! 

Over the course of time, however, hostilities have gradually dissipated, 
and the exact sciences (mathematics, optics, astronomy and physics) have 
increasingly accepted the need for a reflective perspective. However, 
there was a longer lasting and more dangerous knock-on effect of the 
constructivists’ agenda. As the constructivists denounced claims of sci- 
entific certainty as unjustified, they may have unwittingly contributed to 
a shrinking trust in science and so played into the hands of those who - 
for political or financial ends - strategically discredited science. This was 
becoming worryingly apparent at the beginning of the new millennium. 
In 2003, two years after the terrorist attacks on the twin towers of the 
World Trade Center in New York, the influential STS scholar Bruno 
Latour expressed this concern in a lecture at Stanford. He warned that 
criticism of science was out of control. After decades of critical work on 
“hastily naturalized, objectified facts”, he held that “dangerous extrem- 
ists” were destroying “hard-earned evidence”, evidence that could save 
lives. Latour summed up this self-reflexive critical gesture as follows: 
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“Have we behaved like mad scientists who have let the virus of criticism 
out of the confines of their laboratories and now can do nothing to limit 
its harmful effects; it is now mutating and gnawing away at everything, 
even the vessels in which it is enclosed? ”33 

Since the mid-1990s, studies on the criticism of science have focused 
on the attempted discrediting of science within the context of political 
or economic conflicts of interests.*4 In this field, a strand of research has 
developed under the heading of “agnotology”. First coined by Robert 
N. Proctor, agnotology refers to the study of ignorance.” Researchers 
in this field are particularly interested in how ignorance is deliberately 
constructed to raise doubts about the validity of established views. 
Research on the strategies adopted by agents such as pharmaceutical 
companies, chemical industry and political think tanks have shown how 
scientific evidence is intentionally corroded by funding research to pro- 
duce counter-evidence.*® 

The authors of this book, however, are less interested in such forms of 
strategic de-construction of certainties than in furnishing a more com- 
prehensive perspective on evidence criticism and contestation of scientific 
findings. In other words, they also consider the positive and productive 
sides of evidence contestation. How, for example, can questioning pre- 
viously accepted certainties open up new paths for research on nuclear 
security and safety? They ask what else and who else has caused and is 
causing the crisis of certainty. They aim to explore whether and how the 
contestation of evidence actually provides spaces for the development 
of new forms of evidence practices. And they investigate how the legiti- 
macy of both critique and contestation is negotiated. 

Critical accounts of EBM and EBP have assessed the application of 
pre-determined evidence evaluation criteria in decision-making.* This 
scholarship has challenged the assumption of evidence as a neutral arbi- 
ter in political controversies or when difficult treatment decisions have to 
be made.°® In the context of medicine and healthcare, some have argued 
that in addition to quantitative evidence produced in clinical studies, 
so-called subjective evidence, for example patient diaries and narra- 
tives, should be considered.*? As Trisha Greenhalgh puts it, “narrative, 
phenomenological, and ethnographic research designs should be viewed 
as complementary rather than inferior to epidemiological evidence - 
though qualitative, like quantitative, research must be appraised for 
rigor and relevance”.*° In particular, patients can help researchers gain 
new insights, via their understanding and experience of their illness, 
which would otherwise be unaccounted for by more traditional meth- 
odological approaches. 

The distinction between objectivity and subjectivity — or, to be more 
precise, what is taken to be objective and subjective — has long been 
of interest to philosophers of science who have investigated the value- 
ladenness of knowledge production and argued that values influence 
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the generation and interpretation of empirical evidence. For instance, 
according to feminist scholars such as Helen Longino and Alison Wylie, 
value-laden background assumptions influence what data is taken as evi- 
dence.*! Sabina Leonelli’s work on big data supports this point.*” Raw 
data in itself is not evidence. Activities involved in collecting, archiving 
and organizing data are essential if they are to be used as evidence for 
or against a claim. 

So, if evidence is not a neutral, value-free object, is the objectivity of 
science an unachievable ideal? No, some argue. What is required is a 
broader understanding of objectivity. Lorraine Daston and Peter Galison 
have made us aware of the fact that the meaning of objectivity has both 
changed over time and reflects the respective societal context of scientific 
practice.*? Proctor states that the “objectivity of science depends upon 
certain aspects of contextuality”.** Such aspects of contextuality are for 
him the fact that knowledge may serve political interests and that knowl- 
edge is necessarily contingent. This requires us to ask new questions, but 
not to jettison the ideal of scientific objectivity and evidence. Objectivity 
can be preserved when it is not determined as antithetical to subjectivity. 
Inter-subjectively accessible evidence may count as objective because it 
allows justifications from a common point of view. For Ian Hacking, 
standards of objectivity are shaped via styles of reasoning and they rest 
on intersubjectivity.* 

Scholars in the field of STS and history of science have observed how 
evidence conflicts become proxy battles for political conflicts and have 
asked what consequences this has for the fate of democracies.** When 
expert contestations of facts and data supplant societal negotiations 
on values and worldviews, the culture of public debate vital to healthy 
democracies is lost. A culture of constructive controversy, however, 
needs a common ground to make sense of disputes. Alexander Bogner 
finds this common ground in an abstract idea of truth and valid facts as 
necessary fictions.“ We argue that our focus on practices of evidence 
and evidence contestation can lead to a more concrete understanding 
of how such common ground can be gained and how the de- and re- 
stabilization of evidence play out. 


Evidence Contestation as an Academic and a Societal Issue 


One could tentatively arrange the variants of what we call evidence 
contestation on a continuum: Starting from the academic sphere, in 
which evidence is critically examined, but in itself non-negotiable in 
its ontological magnitude, it extends to the social sphere, where what 
is considered relevant and reliable evidence is increasingly questioned 
by multiple actors and from conflicting perspectives. By differentiating 
these practices of evidence contestation according to the results they 
yield, it becomes clear that they range from (in the main) constructive 
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evidence critique among peers in academia to challenging evidence for 
use as a basis for decision-making. At the extreme end of the spectrum 
are practices that are deliberately destructive of what is widely consid- 
ered evidence. This form of contestation often has harmful effects on 
democratic societies. 

Academia is — besides the legal sphere — the arena in modern socie- 
ties in which evidence critique has, from early on, been cast in an insti- 
tutionalized form.* As organized skepticism, its function is to work 
as a guarantor of the reliability and trustworthiness of scientific find- 
ings. Peer-review procedures, conferences or intra-scientific debates 
as forms of exposing new findings to the criticism of colleagues have 
been established for precisely this purpose: The aim is to make sure that 
possible mistakes and biases by individual researchers are discovered 
and corrected. Scientists as actors of evidence critique within academia 
have internalized organized skepticism as an ethical norm that requires 
a commitment to solid evidence for validity claims. Thus, when scien- 
tists are asked to provide unambiguous and certain evidence, it is a vir- 
tue rather than a vice that they are reluctant to do so. However, when 
users need clear advice to support decisions, which scientists are hes- 
itant to deliver, tensions are provoked. For example, in the context of 
policy-making, evidence is expected to provide a firm basis for ground- 
ing debates. As the COVID-19 crisis clearly demonstrated, extreme time 
constraints and the need for rapid response and action may override the 
pre-established principles of scientific validation. During the pandemic, 
studies were occasionally published before passing the usual peer review 
process as the crisis necessitated immediate choices.* When institution- 
alized evidence criticism was suspended as new evidence was published 
prior to peer review, widespread public questioning of decisions made on 
this basis became even more intense.50 

This is not confined to current events. The research and development 
of the first nuclear bombs during World War II, known as the Manhattan 
project, revealed a similar dynamic. The military required immediately 
available results to quickly build the bomb and determine the outcome of 
the war. One of the bottlenecks of the project was the production of fis- 
sionable material. The nuclear scientists and engineers explored various 
methods but remained skeptical and hesitant when asked to decide on 
a solution. This upset the military. Because of the shortage of sufficient 
evidence pointing to the one best way, Lieutenant General Leslie Groves, 
the military head of the Manhattan project, decided to try all possible 
routes regardless of costs. Time was more precious to him than money.*! 
These examples clearly demonstrate that the scope and procedures of 
evidence critique in the academic realm are influenced by the factual and 
temporal constraints of real-world evidence application. 

The firm anchoring of systematic skepticism and evidence criticism 
within the sciences also determines their innovative potential, which 
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unfolds in the remarkable changeability of scientific disciplines and 
research fields. The development of the sciences over the last two centu- 
ries bears ample witness to this. Paradigm shifts, the turn to new per- 
spectives, new interpretations of facts, the use of new epistemic practices 
and technologies and the split or the merger of scientific fields, are all 
processes that rest on evidence contestation. They are, however, anything 
but smooth developments, implying serious conflicts, grinding contro- 
versies and confrontations that are fought on various fronts. Several 
contributions in this collection refer to such conflicts, controversies and 
confrontations. 

Evidence contestation, however, seldom stays within the confines of 
academia, and more often than not, it is initiated by problems and cri- 
ses that emerge outside of academia. Whether it is changing ideas about 
gender roles or altered perceptions of what is considered autochthonous 
and what is alien, such major societal paradigm shifts have had impor- 
tant consequences on the way formerly established evidence is criticized 
within science. Capturing these blurred lines and connections emanating 
at the borders between academia and society became our focus during 
the work on this book. As diverse as the origins of quite different contro- 
versies may be, when the main actors fighting them are scientists or prac- 
titioners of academic professions, they have in common a shared belief 
that conflicting claims can be resolved. This belief legitimizes evidence 
contestations and confers on them the status of productive dissent. As the 
eminent sociologist Georg Simmel states, each conflict must be founded 
on a basic agreement. In academia, the striving for a scientific truth pro- 
vides the common ground on which fierce disputes can be fought out.*? 

Evidence is crucial not only for the justification of validity claims 
within the sciences, but also as a warrantor for success when scientific 
claims are put to use in the diverse contexts outside of scientific prac- 
tice per se. Over the course of the 20" century and especially toward 
its close, promoting science was increasingly seen as an investment that 
promised high returns, such as technological innovations, competitive 
advantages and political advice for statist and private investors alike. 
Thus, the practical applicability of science became more important 
than ever before." The flipside of growing expectations of the immedi- 
ate utility of scientific findings was the disturbing experience that new 
scientific evidence uncovered new fields of ignorance and uncertainty. 
Furthermore, application-induced contestations of evidence increased, 
because practicing evidence in practical contexts is different from prac- 
ticing evidence within the sterile context of science. Nancy Cartwright 
puts it this way: “What a claim means in the context in which it is first 
justified may be very different from what it means in the different con- 
texts in which it will be put to use”. She further states: “What justifies a 
claim depends on what we are going to do with that claim, and evidence 
for one use may provide no support for others”.*4 
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What kind of evidence is appropriate for which use is not just a dif- 
ficult, but also a heavily contested issue. Many actors with a myriad of 
motives and diverse priorities and preferences become involved in mak- 
ing choices based on evidence that is applicable for a certain use. The first 
group of actors constitutes the primary generators of evidence. These 
include researchers in universities and other public or privately funded 
academic institutions, as well as research staff members of industrial 
and commercial enterprises. Depending on their contracting authority, 
the researchers determine the usability of the evidence they have pro- 
vided either more broadly or narrowly. Whereas university researchers 
may have more leeway when they commit to a research topic, industrial 
researchers are predominantly determined with regard to a concrete field 
of application. The researchers’ closeness to the application of evidence 
also depends on how far they have or actively seek access to users or 
people affected by the applied evidence. 

When evidence is generated far away from the places of its applica- 
tion and without concern for the context of use, skepticism and con- 
testation of decontextualized evidence is highly probable. Thus, the 
need arises to bridge the gap between production and application. New 
actors become involved either to facilitate the transition of evidence 
to application or to prevent its use. In these cases, we see that the 
transition from the generation to the application of evidence is a criti- 
cal process that takes time and occupies space. Here, various societal 
actors, ranging from certified or self-proclaimed experts via organized 
activists and engaged citizens to affected laypeople such as patients, 
consumers or local residents, to name just a few, become involved and 
participate in debating the validity of the claims in question. It is in 
this interspace where controversies unfold and procedures to resolve 
the conflicts must be found. 

It needs to be stressed that the focus on evidence for use implies a shift 
of priorities from knowing to doing. This has an impact on evidence 
contestations. Now, acceptance of evidence or its rejection no longer 
hinges on truth-like criteria alone, but on its potential to facilitate the 
achievement of goals. This again influences evidence conflicts and con- 
testations as it impacts on what is at stake, what needs to be taken into 
account and who becomes involved in stating a case, advising on it and 
making a decision. 

Thus, when we focus our attention on evidence for use we gain a 
more comprehensive understanding of evidence contestations. Looking 
closely at what evidence is required and questioned, misuse of con- 
testations and controversies for vested interests becomes an issue. 
Historians of science who have studied, for example, the tobacco indus- 
try’s intrigues against evidence on the carcinogenicity of smoking have 
detailed such strategic deployment of evidence critique and contesta- 
tion.” Here, the belief in resolution so crucial for productive criticism is 
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compromised by staged controversies that distort evidence from ordered 
and manipulated studies. 

In contrast to the scientific field, between science and society, the 
channels and tools of critique in the debate about valid knowledge 
have been established and consolidated in recent decades. Many of them 
have become institutionalized, and thus societally accepted as legitimate 
forms of public participation and building blocks of a deliberative democ- 
racy.°° Public hearings, consensus conferences and stakeholder meetings 
have become integral to decision-making processes at many levels.57 One 
recent example of such institutionalized forms of contestation are citi- 
zen assemblies. Appointed to enable more meaningful dialogue among 
citizens, experts and governments, they provide more room for produc- 
tive critique and deliberative participation than fierce contestation at the 
interface among science, politics and the public, particularly regarding 
pressing issues such as climate change.* In some cases, these measures 
extend to the world level, as international bodies increasingly discuss 
environmental policy issues at global round tables.°? 

In several of the case studies presented in this book, we can see 
attempts by actors to establish such channels for criticizing what is pre- 
sented to them as evidence. Some of the groups that doubt evidence emu- 
late the methods of science by coming up with their own publications 
and pamphlets that take center stage in the context of counter science. 
Others have chosen a different path by using official data for their own 
ends. More recent contesters of evidence make use of digital communi- 
cation channels to question evidence. What we are seeing in all of these 
instances is the development of hybrid arenas between science and soci- 
ety that are populated by quite different actors, ranging from scientists, 
experts and journalists to decision makers and citizens in their capacity 
as patients, consumers, local residents and many others. In these arenas, 
patterns of evidence critique and contestation have evolved that can pave 
the way toward a more inclusive and deliberative democracy. There is, 
however, also the possibility of misguided critique and contestation of 
evidence that in turn may pose a threat to democracy. Rising concerns 
about the advent of the post-truth era point in this direction. 


Dealing with Dissent in Science and Society 


In a variety of case studies, the contributors to this book explore what 
counts as evidence for different actors and under what circumstances 
dissent may emerge and grow. Do they find productive ways to include 
hitherto unconsidered data, facts, sources or observations for justifying 
different knowledge claims or decisions? Can new evidence ever coexist 
with results of evidence practices that were previously accepted? Or does 
novel evidence necessarily trigger conflicts? And, if this is the case, how 
can such conflicts be resolved? 
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Beginning with a theoretical view of evidence critique and contesta- 
tion in the first section, one way to analyze and systematize increasing 
controversies and dwindling consensus regarding evidence is through the 
lens of philosophy. According to Daniel Füger and Elif Özmen, critical 
debate on evidence is an essential precondition for the trustworthiness 
of research. By reviewing the normative functions of criticism, they show 
that questioning the evidential basis of claims enables possible biases 
that might nudge the results of scientific research in one direction or the 
other to be uncovered. The authors treat evidence as a “pre-rational 
choice” of scientists and argue this is both the basis and the consequence 
of the normative setting, which they call scientific ethos. Dissent and 
criticism are possible, but only as long as scientists do not reject the 
institutionalized scientific ethos as a whole. They show that controversy 
has been a characteristic of modern science since its emergence in the 
18 century and continues to be beneficial to this day, both epistemically 
and ethically. 

Another theoretically informed way to consider growing dissent in 
regard to evidence is through the perspective of the sociology of science. 
In their contribution, Eva Barlösius and Eva Ruffing develop a heuristic 
to distinguish between three modes of contestation of scientific evidence, 
knowledge and expertise in contemporary knowledge societies. These 
three forms of contestation affect the recognition of science and can 
have destabilizing consequences at different levels. If the first mode 
problematizes scientific evidence per se, the second mode questions its 
political use. The third mode challenges the relevance of scientific evi- 
dence for political decision-making. This heuristic is used to show how 
important the tension between trust and distrust in scientific knowledge 
can be, especially in situations of social destabilization and increasing 
dissent, as seen in the COVID-19 pandemic. With reference to the third 
form of contestation, the authors suggest that escalating disputes can be 
expressions of socio-structural and political struggles. In these conflicts, 
it is not evidence that is contested, but the way political solutions are 
arrived at. 

The second section hones in on examples of dissent within evolution- 
ary biology and ecology. In these cases, we observe that conflicts tak- 
ing place between academics may have originated outside the academic 
sphere. The actors who challenge established evidence here have faced 
backlashes not only from within their disciplines, but also from beyond - 
and responded to them in various ways. Starting from changing soci- 
etal norms, the evolutionary biologist Joan Roughgarden, whose case 
is delineated by Martha Kenney, contested Darwin’s theory of sexual 
selection by presenting new evidence combined with storytelling in the 
early 2000s. The majority of her peers in evolutionary biology outright 
rejected Roughgarden’s claims about sexual selection for two reasons: 
First for challenging Darwin’s master narrative from a marginalized 
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subject position and second for referring to contemporary US gender 
politics in the context of science. Roughgarden responded by calling on 
her colleagues to test hypotheses beyond the neo-Darwinian orthodoxy. 
She argued for the coexistence of various hypotheses, each confirmed 
with results from evidence practices that the respective researchers con- 
sidered appropriate. Roughgarden made the case for accepting dissent 
and pluralism in the sciences. Why this was a reasonable decision can 
be understood with the help of the philosopher Nicholas Rescher. He 
argues for scientific pluralism for the following reasons: 


The diversity of persons, cultures and experiences makes the goal 
of actually realizing consensus in cognitive or evaluative practical 
matters effectively impracticable and unrealistic. Only by abstract- 
ing from the physical and social realities — shifting to the level of 
idealization — can we require or expect a valid consensus.°! 


The case study on invasive species research traces the shift from an eco- 
logical expert culture largely immune to critique to one that needs to 
embrace pluralism and disagreement in the face of growing dissent in the 
rapidly changing field of ecology. Christoph Kueffer shows how a small 
and homogeneous group of experts successfully framed the socioecolog- 
ical problem in the postwar period in such a way that their advice was 
adopted by decision makers and consequentially engendered policies on 
all levels without much contestation. The generalized rules they formu- 
lated about ecology often trumped growing real-world evidence. Since 
the 1990s, however, scientific expertise and policy-making related to 
biological invasions have increasingly been exposed to dissent, forcing 
scientists to respond to such contestations of evidence by diverse actors 
within the sciences and in society and making it more difficult to reach a 
consensus on actions. As one way to embrace this new pluralism and dis- 
agreement, Kueffer discusses the honest broker strategy. Contemporary 
invasion scientists attempt to maintain their central role in providing 
information while also allowing for more diversity and participation in 
research and decision-making processes in order to render the valuation 
of alien species impacts more socially robust. While it is questionable 
whether such a strategy will suffice to contain evidence critique, it func- 
tions as one approach for achieving consensus on how to react toward 
biological invasions as one of the many challenges of the Anthropocene. 

The third section on the health sector focuses on tensions and con- 
flicts between intra-scientific evidence practices on the one hand, and 
evidence generation in application contexts on the other. In their con- 
tribution, Saana Jukola and Mariacarla Gadebusch Bondio analyze the 
recent US debate concerning surgical headwear and guidelines for surgi- 
cal wear as preventive hygiene measures. In this dispute, the Association 
of periOperative Registered Nurses (AORN) and their critics dealt with 


16 Karin Zachmann et al. 


dissent by referring to evidence and different criteria for assessing evi- 
dence. Eventually, AORN guidelines were rephrased. In their analysis of 
the argumentation strategies used in different international contexts (the 
US and Germany) by diverse professional groups (surgeons and periop- 
erative nurses), Jukola and Gadebusch Bondio argue that this case illus- 
trates the importance of considering the role of authoritarian structures 
in how arguments and positions are formed. Unlike the US, in Germany, 
there has been no debate about the guidelines for what kind of headwear 
should be worn in operating theaters. This implies that it is important 
to consider how non-epistemic concerns and epistemic values are inter- 
twined in evidence disputes. 

Sometimes experts aiming at evidence-based decision-making are faced 
with evidence discordance. In these cases, decision makers have to find a 
means of first assessing the available evidence, and, second, deciding which 
evidence to act upon. The task becomes more complicated when there is 
no clear agreement as to what criteria to use for assessing evidence. The 
contribution by Fredrik Andersen, Yngve Herikstad, Anders Dechsling, 
and Stefan Sütterlin addresses this problem. The case they analyze is the 
development of the Norwegian National Guidelines for the Treatment 
of Substance Use Disorders and Addiction. As the authors note, in this 
instance, “there is contestation concerning a wide variety of issues such 
as legality, treatment, the nature of the disease, the quality of evidence 
and the general ideology of treatment”. Yet all evidence evaluation meth- 
ods and criteria can be contested: For example, it is not clear if certain 
methods of producing evidence (e.g. RCTs) should be favored over others 
or whether local evidence should be preferred. In their chapter, Andersen 
et al. discuss different evidence amalgamation methods that could help 
expert groups reach consensus in light of diverse evidence. Reaching con- 
sensus is necessary in this case, as the aim of the evidence evaluation is to 
produce guidelines for the treatment of addiction issues. Andersen et al. 
suggest that the so-called explanatory approach to evaluating evidence 
could help to solve the problem of how to deal with evidence discordance. 

The fourth section focuses on challenges to evidence from estab- 
lished science by non-academic actors. In Stefan Esselborn and Karin 
Zachmann’s case study on the development of counter science in 
Germany since the 1970s, we see a propagation of evidence contesta- 
tion from the socio-epistemic to the institutional level. The protagonists 
of counter science not only set up alternative institutions such as the 
Öko-Institut. They also emulated the methods of science by coming up 
with their own publications and pamphlets, in order to provide evidence 
that was needed by the anti-nuclear movement in court cases on nuclear 
power, or by citizens concerned about further environmental and soci- 
etal issues. Seconded by critical but established voices within academia, 
counter researchers wrestled with the question of how to produce good 
evidence and for whom. Responses from not only conventional academic 


Evidence Critique and Contestation 17 


institutions and their actors, but also industry and governmental insti- 
tutions, on the evidence claims of the dissenters at first ranged from 
irritation to strict denunciation. Over time however, the hostility on 
both sides ran dry and the counter researchers managed to fill a niche in 
the market of knowledge and expertise. Two drivers pushed the integra- 
tion of counter science into the evidence regime that was thereby evolv- 
ing more plurality: First, structural changes connected to increasing 
demands for participation and reflexivity in (mainstream) science; and 
second the wish for intellectual acceptance and the need for funding on 
the part of the counter researchers. 

Exploring the confrontations on pesticide use, Sarah Ehlers highlights 
what practices of evidence contestation environmental activists devel- 
oped to achieve a ban on pesticide exports from the Global North to 
the Global South during the 1970s and 1980s. While one strategy of 
the activists was to use official data for their own ends, another was to 
dismantle the results of cost-benefit analyses provided by the chemical 
industry and other beneficiaries of pesticide exports by way of taking 
real-world evidence into account. By appropriating and using evidence 
from diverse sources, the environmental activists challenged the hitherto 
established experts and political decision makers. Resolving the conflict 
required a renegotiation of what is accepted as appropriate evidence and 
exposing hidden inequalities that had precluded the application of cer- 
tain facts, data and observations as relevant evidence for decisions in 
advance. Here, dealing with dissent was not a question of pluralism and 
liberty, but of justice and equality. 

Citizen science, which has advanced as a publicly supported move- 
ment in Western states since the turn of the millennium, is first and 
foremost an activity that tries to extend the range of participatory 
democracy. Laypersons, who gain access to the realm of established 
science as contributors and participants, challenge the social exclusive- 
ness of academia and its validity claims based on certification. Kevin 
Altmann and Andreas Wenninger investigate whether selected citizen 
science projects in Austria and Germany transform professional science 
not just in a social sense, but also in the factual dimension. In their view, 
the latter implies potential for evidence contestation when citizens man- 
age to introduce critical questions and content into science. The authors 
show that professional scientists try to offset the impact of dissenting 
citizen perspectives on science by securing professional control of citizen 
science projects. In the interplay of differently institutionalized modes 
of citizen science, current knowledge societies must balance critical and 
constructive impacts. 

Section five, on conveying academic evidence, highlights a further 
expansion of contestation. Edoardo Maria Pelli and Jutta Roosen show 
that a young field of research and application can provoke uncertainty 
or contradictory positions. Nutrition science, for example, is frequently 
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criticized for methodological weaknesses and for being influenced by 
the food industry. The decision-making process for consumers seeking 
a healthy diet is often complex, as action has to be taken, even though 
there is no clear evidence indicating a distinct direction to follow. The 
authors analyze one such case, namely consumers’ attitudes toward 
so-called superfoods, marketed as having an exceptionally high nutri- 
tional value, when there is actually little scientific evidence for the health 
benefits of these foods. This raises the question how consumers decide 
whether to purchase and consume superfoods. Applying moral founda- 
tions theory (MFT), the authors explain that consumers’ food attitudes 
are formed in the absence of strong evidence. According to Pelli and 
Roosen’s application of MFT, attitudes are guided by intuitive moral 
judgments concerning a particular object or phenomenon, rather than 
only by rational processes, as suggested by traditional neoclassical eco- 
nomics. Consequently, attitudes toward nutritional aspects of food may 
be moderated by moral values. This helps understand how laypersons 
circumvent uncertainty or dissent concerning fuzzy evidence and make 
choices in their everyday life. 

The case study of evidence criticism in journalism highlights a particu- 
lar way of voicing dissent. Using the example of the societally controver- 
sial field of genomic research, Helena Bilandzic and Susanne Kinnebrock 
take a close look at journalistic strategies for contesting scientific evi- 
dence. While science journalists do not produce evidence themselves, 
they communicate scientific evidence to wider audiences. In the majority 
of cases, they present scientific findings in a neutral or supportive way. 
Confrontation or rather dissent, by contrast, appear as an exception and 
do not target scientific results per se, but their ethical implications on 
society. In these rare cases, journalists use narrative strategies to criticize 
the research. While references to mythical accounts of human hubris 
have become classic, they also use the personalized topos of the “mad 
scientist”, or references to authorities, experts, institutions or academic 
journals, to question the trustworthiness of the scientists and/or institu- 
tions producing the evidence. By presenting the findings in one way or 
another, they add to their perception as true or invalid or they “under- 
line or undermine” them. The effect of this kind of narrative dissent on 
public trust or distrust in science stands in need of further investigation. 

What do these many observations and findings from different dis- 
ciplines and societal contexts offer when dealing with dissent in 
contemporary knowledge societies? The case studies in this collection 
showcase polyphonic doubt and debate regarding evidence both within 
academia and beyond. What we have seen is that the number of people 
who criticize evidence has multiplied and diversified in recent decades, 
as have the arenas where contestations take place. Once confined to 
academia and committed to the search for truth or optimal solutions, 
respectively, criticism and contestation of evidence have spread into 
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society at large. Here, an essential feature of today’s knowledge societies 
emerges, in which scientific research is advancing to become the domi- 
nant model of action. “Systematic and controlled reflection becomes a 
widespread principle of action in society”, notes Peter Weingart.°° This 
in turn entails the multiplication of evidence critique beyond academia. 
Much current criticism and contestation is triggered by one of two 
things: Either conflicts resulting from putting evidence to use or calls for 
more appropriate and comprehensive evidence. 

But what does such growing dissent mean for society and how can a 
common ground be reached despite the increasing diversity and legit- 
imacy of various perspectives and the clamoring and often competing 
challenges? It may help to compare the current situation of late modern 
knowledge societies with the advent of the enlightened, bourgeois order 
more than 200 years ago. At that time, Immanuel Kant developed his 
radical theoretical-philosophical concept of critique, most famously in 
his Critique of Pure Reason.°* However, Kantian critique did not address 
the public but was confined to the egalitarian model of the scholarly 
republic. In the history of political semantics, Kant’s radical demand for 
a freedom of critique is seen as a palliative to the violence and terror of 
the political revolution in France.‘ In contrast - and this is what the case 
studies of this book show - current knowledge societies have extended 
the entitlement to evidence contestation beyond the walls of academia 
and thus embraced dissent as a generally constructive force for the whole 
of society. To some extent, however, we are still caught in the Kantian 
mindset when we frame political dissent and value conflicts as evidence 
contestation. This is what scholars like Alexander Bogner address when 
they warn against the dangers of an epistemocracy.®* Circumventing 
these dangers requires openly addressing the political and value dimen- 
sions that are embedded in all evidence claims. The contributions to this 
volume show how this can be, and is, done. 
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1 What Is Scientific Criticism for? 
Some Philosophical Reflections on 
Criticism and Evidence within the 
Scientific Ethos 


Daniel Fiiger and Elif Ozmen 


The need for scientific evidence and evidence-informed decision-making 
increased tremendously during the coronavirus pandemic. In recent 
years, evidence has therefore become a central concern in public and pri- 
vate debates, policies and far-reaching decisions. At the same time, most 
people, including politicians, find it difficult to understand and handle 
the uncertain and changing character of evidence on the development, 
dissemination and pathogenic effects of the coronavirus. Nonetheless, 
confidence in science has increased significantly compared to the years 
before the pandemic.! But how is it possible to develop trust when 
evidence as a core aspect of scientific inquiry and science-based advice is 
under constant threat of being de-stabilized and revised? 

Most activities aimed at achieving knowledge, and scientific activi- 
ties in particular, require evidence. Producing evidence and referring to 
evidence ensures the robustness of scientific hypothesis and the qual- 
ity of scientific theories. Moreover, evidence is necessary — albeit not 
sufficient — for a scientific activity to be acknowledged both within the 
scientific community and society in general. Science depends on criti- 
cism, which not only includes evaluation, judgments and disapproval, 
but also the contestation of evidence. While scientific evidence serves to 
either support or counter a scientific hypothesis, its contestation is only 
partly a devaluation of previous research findings and mostly a common 
practice within science. How can these two aspects of evidence genera- 
tion, which we take for granted, coexist? How in particular are evidence 
and the contestation and critique of evidence related to the norms of 
scientific activity? And what are the ties and tensions between the con- 
testation of evidence and criticism of science, between scientific ethos 
and societal norms, and more broadly speaking between science and the 
public recognition or refutation of scientific knowledge? 

We assume that a philosophical approach will help to address these 
questions by critically evaluating the underlying concepts. Our main 
focus lies on the normative aspects of evidence and evidence criticism 
within scientific ethos. On the one hand, it seems perfectly clear that 
science must (and mostly can) justify why and how it relies on specific 
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evidence practices. On the other hand, these practices and scientific 
justifications are reliant not only on inner-scientific but also on non- 
scientific normative claims, e.g. social, political and moral values. As 
we will show in the following, these normative claims are very impor- 
tant in dealing with quid iuris questions about evidence. We hope that 
our contribution to this volume will help to understand the normative 
conditions and functions of evidence and its contestation as part of the 
normative foundations of science as a whole. 

In the first section of this chapter, we clarify what scientific criticism 
entails and what distinguishes it from general skepticism about science. 
We examine the historical and systematic meaning of the term criticism 
in order to contextualize it within science. In the second section, we 
highlight our understanding of evidence as a normative standard in 
science which is at the same time contested, dynamic and ambivalent. 
But there is common ground insofar as scientific criticism in general, 
and criticism of evidence in particular, is built on a shared conception 
of evidence. We present this conception with the heuristic of agnosti- 
cism of evidence, which allows us to approach the ambivalent functions 
of evidence. In the third section, we examine the interactions between 
evidence and criticism within the normative setting of science. In par- 
ticular, we conclude that the so-called scientific ethos is both a neces- 
sary condition for scientific practice and a result of this practice. The 
fourth section addresses the role of contingencies in science and the 
openness and ambiguity that they constitute. We suggest that criticism 
and contingencies, partly driven by the ambivalent character of evi- 
dence, nevertheless contribute to the stability of science. In addition, 
we look at the causes of contemporary evidence crises that arise, among 
other things, when the legitimation of science within democratic soci- 
eties fails. 


What Is Scientific Criticism for? 


In this section, we attempt to clarify the idea of scientific criticism with 
reference to systematic considerations and historical developments. We 
are particularly interested in the stabilizing effects of this criticism 
for the shaping and establishing of modern science. Philosopher Helen 
Longino distinguishes between two types of criticism with regard to 
their productive role within science. Evidential criticism is consid- 
ered the basis of experimental and observational research; its main 
aim is to identify the degree to which a scientific hypothesis is sup- 
ported by evidence. Conceptual criticism deals with more theoreti- 
cal and metatheoretical problems of science, insofar as the conceptual 
soundness of an inquiry is questioned, the consistency of a hypothe- 
sis with an accepted theory is reviewed and the relevance of evidence 
in support of a hypothesis is tested.* Both types of criticism are key 
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elements of scientific inquiry and scientific progress, and it is impor- 
tant to note that these practices of criticism differ from simple or spon- 
taneous expressions of objection, opposition or discomfort. Scientific 
criticism should be linked to “recognized avenues for the criticism 
of evidence, of methods, and of assumptions and reasoning” and to 
“shared standards that critics can invoke”. The knowledge and rec- 
ognition of the rules (or the ethos, as we refer to this later) of science 
and scientific criticism is required, including an open-mindedness to 
critical responses from the scientific community and the appreciation 
of equal intellectual authority between the members of the scientific 
community. Scientific criticism addresses problems within science and 
seeks better or new methodologies, explanations and justifications. 
However, scientific criticism needs to be explained, justified and meth- 
odologically specified. 

The close ties between criticism and justification, critique and rea- 
sonableness that we currently take for granted are in fact the result 
of a long historical development that culminated in the idea of a 
dynamic process of criticism during the Enlightenment. The ancient 
Greek term krinein (to judge, recognize, argue) refers to judgments, 
mostly in philological or medical contexts. The same applies to the 
Latin term criticus. In the 15' and 16" centuries, the logical and meth- 
odological dimensions of criticism were established, but the scientific 
significance of criticism emerged clearly in the 17 century, where crit- 
icism was linked to mathematical science and other methodological 
changes in scientific practice, such as the ars critica in linguistics or 
a methodological criticism in history.* Enlightenment philosophy had 
a particularly significant impact on the scientific imprint of criticism 
and its public recognition. Broadly speaking, in the 18'% century, cri- 
tique and criticism becomes an application and condition of reasoning 
itself. In the entry “Critique” of Denis Diderot’s Encyclopédie (1751), 
it is understood as the very activity of reason that subjects all kinds of 
objects to scrutiny — physical, but also social and moral facts, theories, 
arguments, interpretations, speculations, opinions — by bringing them 
before a tribunal of truth: “It would be desirable for a determined and 
enlightened philosopher to dare to put these judgments, made over the 
centuries by flattery and interest, before the tribunal of truth”. The 
clearest formulation of the idea of an impartial court of reason, which 
is always and only committed to the truth, can be found in Immanuel 
Kant’s famous Gerichtshof der Vernunft: 


One can regard the critique of pure reason as the true court of justice 
for all controversies of pure reason; for the critique is not involved 
in these disputes, which pertain immediately to object, but is rather 
set the task of determining and judging what is lawful in reason in 
general in accordance with the principles of its primary institution. 
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Without this, reason is as it were in the state of nature, and 
it cannot make its assertions and claims valid or secure them 
except through war. The critique, on the contrary, which derives 
all decisions from the ground-rules of its own constitution, 
whose authority no one can doubt, grants us the peace of a state 
of law in which we should not conduct our controversy except 
by ‘due process’.® 


To take Kant’s metaphor even further, criticism plays three main roles 
in the court of reason at the same time: The accused, the prosecutor and 
the judge. The same applies to the critical philosopher. At first, criticism 
is used to object to a position. Then the criticism itself is discussed. And 
finally, it acts as the judging institution. As a consequence, criticism can 
be understood as the application of different aspects of reason and rea- 
soning itself. 

It is no coincidence that criticism and the establishment of modern 
scientific practice developed in parallel. In the 17 and 18 century, the 
“era of evidence”,’ Aristotelian natural philosophy was replaced by cul- 
tures and practices of evidence.’ At the same time, a self-image of scien- 
tific inquiry conducted by scientists as a profession was established and 
institutionalized, primarily in the new scientific academies.’ Following 
Wilda C. Anderson, a thus institutionalized self-image leads away from 
the Aristotelian ideal of the theorizing philosopher, who contemplates 
about the world, to the scientist, who is in search of the “speaking voice 
of nature” in experimental data.!0 Precisely this non-contemplative but 
hands-on and experimental access to nature influenced the conception 
of scientific evidence drastically.!! As a result, experimental practices 
not only had an impact on the status of evidence within science but also 
determined the self-conception of scientists.!? 

This short historical excursus illuminates our systematic stance, 
namely that scientific criticism contains a demanding and normative 
ideal of proper or just critique of science. Hence, good critics should be 
familiar with the acknowledged avenues of scientific critique since first 
and foremost their utterance must be compatible with common scientific 
norms. Scientific criticism that is bound to fundamental structures in 
this way cannot develop into a general criticism of science as it would 
then destroy its own foundation. No matter how critical scientific crit- 
icism is, it must follow the institutionalized pathways of science. That 
does not mean that criticism cannot influence these internal norms by 
commenting on previous scientific standards and procedures. It can con- 
firm different strategies and establish new standards that future scien- 
tists can use as guidelines. But even profound criticism cannot call the 
institution of science into question as a whole without questioning its 
own claim to be scientific criticism. 
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First, we need to address the question of what meanings the term evi- 
dence can take on - and here the question of language is important. 
Second, we examine the relation of scientific criticism to evidence claims 
because evidence critique and evidence contestation are common and 
acknowledged ways of showing disapproval in science. This suggests 
that evidence criticism as one option of scientific criticism could have 
similarly productive effects for scientific inquiry and progress. One rea- 
son, as we aim to show in this section, can be found in the epistemic 
robustness of evidence-claims. Following this, we argue that conceptu- 
ally ambivalent meanings and functions of evidence are possible and 
may even be necessary for scientific criticism and progress, as long as 
they do not violate the overriding (but still ambiguous) idea of scientific 
evidence. We hope that the heuristic of evidence agnosticism will help to 
ease the tensions between stability and ambiguity of evidence on the one 
hand and between references to evidence and contestations of evidence 
on the other. 

Starting with a definition of scientific evidence might initially appear 
fairly straightforward: The available body of facts, data or informa- 
tion supporting or contradicting a proposition, assumption, hypoth- 
esis or theory in science. But on further inspection, it soon becomes 
obvious - and problematic for the task of providing a definition — that 
the standards for something to count as evidence and the types of evi- 
dence practices differ vastly between specific scientific disciplines.” It 
is therefore not viable to talk about just one concept of evidence, or to 
justify or even understand certain evidence practices without reference 
to their historical background and institutional embedding. Producing 
and establishing evidence is related to concrete contexts of production 
and application. Praxeological perspectives on evidence and the analysis 
of example cases, as examined in the contributions to this volume, 
are therefore useful and profitable for interdisciplinary research on 
evidence. 

In addition to the interdisciplinary differences, there are general issues 
concerning the ontological, epistemic and methodological aspects of 
evidence, which are negotiated in a variety of philosophical investiga- 
tions on evidence.!* These theoretical contributions confirm that there 
is a persistent ambiguity about the concept of evidence that allows for 
different semantic interpretations. This might at least partially explain 
the pluralism of the disciplinary standards, criteria and practices of 
evidence. 

The German lexeme Evidenz appears at first glance to be more expan- 
sive than the English evidence. It not only means proof (Beweis) but also 
refers to epistemic processes of certainty (Gewissheit). On the one hand, 
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Evidenz provides a ground for a belief or conviction and on the other 
hand the term refers to an obviousness. Furthermore, there is a problem 
in expressing the distinction between an immediate self-evidence and 
evidence as a tool for the confirmation or justification of a proposition, 
hypothesis or theory.!5 This diversity of meanings emerges - especially 
for us as German-speaking philosophers — from a rich history of the 
term that has also strongly influenced English-language philosophy.!* In 
many insightful discussions with English-speaking colleagues, it seemed 
this was a purely German phenomenon. In contemporary English usage, 
the term evidence might appear not to carry this ambivalence and be 
much clearer than its German cognate. Nevertheless, we cannot agree 
with this assumption. We note that a sole focus on the linguistic deno- 
tative and connotative meaning of a term cannot solve conceptual phil- 
osophical problems. 

Moreover, we also see ambivalences in the english term evidence. Let 
us assume that the meaning of evidence is sufficiently covered in “rea- 
sons or proofs for a conviction that something is true”. What could we 
thereby say about the content or cause of evidence? We could say that it 
is the object or the phenomenon itself that provides for our conviction 
without our intervention. Here the path to an attribution of obviousness 
would be very short, for how should something of itself provide convic- 
tion if it is not obvious? Or is it only the process of cognition that turns 
an object or a phenomenon into evidence? Here, however, one would 
have to do some work of persuasion in order to answer the question 
“What makes something evidence?” For the assumption that it is a pro- 
cess of cognition that makes something evidence is circular: The reason 
for the truth of my conviction is the conviction itself. Even though there 
may be philosophical exceptions where we can speak of evidence, for 
example, if there is a minimal change in probability values for truth, at 
first glance, it is difficult to assume that there can be evidence that has 
no link to clarity, immediacy or obviousness. But that does not mean 
that evidence cannot be criticized because it is unquestionably true from 
certainty. As we have also mentioned, criticism of evidence is a common 
part of scientific practice. But such interventions mostly refer to concrete 
evidence themselves and as such do not question the general concept of 
insightful evidence. Here one might counter that we are unjustifiably 
distinguishing between concrete evidence and a general concept and that 
our philosophical problem applies only to the latter. But the singular 
meaning of evidence cannot answer the question of what exactly makes 
a phenomenon evidence, nor why it is justified to treat something as 
evidence. The starting point for our questions about evidence, then, are 
not linguistic equivocations but conceptual ambivalences. Besides the 
linguistic peculiarities, the philosophical concept of evidence exhibits 
persistent ambiguities — at least, if we continue to ask about the philo- 
sophical content of the term. 
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But let us take a closer look at evidence and the possible ambiva- 
lences of the term by considering its history. Etymologically, evidence 
derives from two similar yet different sources: Evidentia (obvious) and 
energeia (explicitly visible).'” The term evidence currently has both an 
epistemological and an aesthetic meaning: Something that is evident, 
can be understood immediately, is true, justified or existent beyond 
doubt. At the same time, evidence is particularly accessible when it is 
equated with sensual insights or immediate perception.'® On the one 
hand, evidence corresponds to a special form of clarity and therefore 
is often used synonymously with concepts such as self-evidence, dis- 
tinctness, comprehensibility, unambiguousness and obviousness. On the 
other hand, by systematically providing justification for beliefs and con- 
victions, evidence is connected to a mode of knowledge accompanied by 
demands for certainty, undeniability, objectivity and authenticity.!? 

The controversy over the proper meaning of evidence can also be seen 
in current philosophical debates. From an epistemological viewpoint, 
evidence plays a constitutive role in what we can know with certainty — 
in contrast to mere belief, thinking and subjectively holding to be true.*° 
As Wolfgang Stegmüller has put it concisely: “All of our arguing, deriv- 
ing, refuting, reviewing is a continuous plea to evidence”.*! Such pleas 
are usually put forward with the expectation that it is possible to justify 
our theoretical and practical beliefs in principle. Throughout the history 
of philosophy, this demand for reasonableness and rationality has been 
presented as a connection between epistéme (knowledge) and evidentia 
(certainty), which refers to a direct independent source of knowledge 
that goes along with an irrefutable claim to truth. In epistemology, evi- 
dence is thus related to the concepts of justified belief and knowledge: 
“One thing is ‘evidence’ for another just in case the first tends to enhance 
the reasonableness or justification of the second”.?? Candidates for such 
epistemological evidence differ within different philosophical theories 
and also from historical epoch to epoch. Thus, a systematic overview 
shows a broad range of positions from empiricist concepts of evidence 
(e.g. sense data, direct perception, sensual intuitions, protocol sentences) 
to rationalist positions (e.g. direct intuition, intuitive insight, staunch 
belief, innate ideas, necessary ideas, law of thought).*? Although phil- 
osophical epistemology may not help to define evidence, it does help to 
illustrate a complex relationship between evidence and other basic epis- 
temological categories, such as insight, knowledge, truth, justification, 
which are very powerful in our image of how to reason about the world. 

Empirical and inductive science on the one hand and evidence prac- 
tices on the other, despite their potential to make explanatory statements 
about the world, face a conceptual problem: There is necessarily a gap 
between evidence and general scientific statements. Evidence does not 
by itself determine which scientific statements are true or not. In a case 
of conflict between competing statements, one has to decide whether 
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the available evidence is sufficient or not.24 How can such a decision be 
justified and legitimated? 

Various philosophers see values coming into play here. Such values 
can be both ethical and science-specific, especially since a uniform sepa- 
ration between these categories is not tenable. Feminist scholars call for 
plural and diverse science in order to be able to close gaps by deploying 
a variety of viewpoints. Moreover, such values can have a direct impact, 
i.e. they directly influence decisions made by scientists. But they can also 
have an indirect effect by being taken into account in the evaluation of 
justifications. For the philosopher Heather E. Douglas values in their 
indirect role: 


help determine whether the evidence or reasons one has for one’s 
choice are sufficient [...] but do not contribute to the evidence or 
reasons themselves. In the indirect role, values assess whether evi- 
dence is sufficient by examining whether the uncertainty remaining 
is acceptable. A scientist would assess whether a level of uncertainty 
is acceptable by considering what the possible consequences of error 
would be [...] by using values to weigh those consequences.”° 


If evidence is therefore insufficient and, as we have argued above, there 
are other conceptual problems as well, should we better refrain from a 
philosophical approach to evidence altogether? Such defeatism would 
not do justice to the fact that evidence, despite its inherent ontological 
and epistemological problems, is a central and practice-guiding concept 
in science. Therefore, although the philosophical debates about the exist- 
ence and validity of evidence do demonstrate the complexity of the con- 
cept, these notional confusions may still have no destructive effect for 
evidence-claims and evidence-practices in science. Remarkably, quite a 
few philosophers of the 20" century proposed that the conceptual ambi- 
guity of evidence should be interpreted as a general impossibility of cit- 
ing proofs (or rather evidence) for the existence of evidence.”® After all, 
arguing for evidence requires embracing the very concept that is being 
argued for. From this perspective, the reasoning about and the arguing 
for evidence are ineluctably circular. This would mean that we could not 
give a convincing answer to the question of what evidence is and that we 
(as philosophers of science) should stop trying. But this is not meant as a 
farewell to the concept of evidence or to a philosophical investigation of 
evidence. Rather than defeatism we propose agnosticism as a philosoph- 
ical approach to dealing with the problems of evidence. 

In this regard, we would like to suggest a heuristic to make the ambi- 
guity of evidence comprehensible without undermining the epistemic and 
scientific relevance of this concept, nor denying its persistent epistemic 
problems or neglecting its scientific functions. The heuristic figure of an 
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agnosticism toward evidence regards it from the outset as a pluralistic, 
ambiguous and highly contested concept with inherent contingencies — 
but still as a concept with an important normative function in terms 
of the authority and recognition of science. Accordingly, evidence is an 
abstract, qualitative and evaluative notion with a variety of meanings. 
Such essentially contested concepts “inevitably involve endless disputes 
about their proper uses on the part of their users” which “cannot be 
settled by appeal to, linguistic usage, or the canons of logic alone”.?’ 
Thus, evidence can still be regarded as one of the basic concepts of phi- 
losophy, because it addresses the question of how knowledge is possible 
or beliefs are justified. It illustrates the focus and main motives of epis- 
temology and the philosophy of science. This makes evidence part of the 
conceptual inventory of the “disenchantment of the world” by processes 
of objectification, rationalization and mechanization brought about by, 
among other things, modern science.?® 

But at the same time, we can face up to the presented epistemic and 
ontological problems of evidence by shifting from epistemology to 
practical philosophy of science. This entails a change of perspective: 
Evidence is no longer just seen as a crucial concept in epistemology 
and scientific inquiry, but as a matter of collective convention or even 
individual belief with no rational foundation. Wolfgang Stegmiiller, 
who invented the idea of Evidenz-Agnostizismus, claims that scientific 
practice itself can neither justify nor produce evidence by itself. This 
means that one needs criteria outside of the purely epistemic practice 
of science to label or understand something as evidence (criteria such 
as values, heuristics or normative agreements on thresholds). Hence, 
for Stegmiiller, every single concept and scientific use of evidence 
should be seen as the result of a vorrationale Urentscheidung (pre- 
rational original decision): “[I]n scientific practice we cannot do without 
the assumption of evidence or insight. But the fact that we cannot do 
otherwise is no justification”.?? Stegmüller points out that a justifica- 
tion of evidence could not rely on rational insights, “pure thinking” or 
decisions absent of reason. Instead, we have to assume a practical belief 
in evidence (“Evidenz-Glaube”), which is not justifiable and therefore 
not based on a rational foundation but is normatively effective never- 
theless.30 In other words, even if criticism of individual evidence is pos- 
sible (usually by referring to other evidence), it is important to consider 
belief in the general concept of evidence as a basic decision. Criticism of 
evidence does not mean rejection of all evidence. The heuristic of agnos- 
ticism allows us to establish a new starting point for investigating why 
scientists are justified in believing in evidence, although there is no foun- 
dational justification of evidence. Hence, we can ask for the normative 
requirements, functions and consequences of scientific evidence, as we 
now do in the next section. 
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One can reasonably assume that good scientific practice yields reliable 
knowledge about the world due to the standards and requirements that 
are necessary for a scientific outcome. But what are the normative rea- 
sons and conditions for good science? In this section, we address this 
question by examining the functions of evidence in the normative setting 
of science — the scientific ethos. In this way, it should become clear that 
the normative function of evidence has important implications for the 
general understanding of science and scientific criticism. 

“What aims should this discipline pursue?” and “What should science 
look like?” are not merely questions referring to scientific methods or the 
validation of facts, but to normative aspects that are highly relevant for 
the status of science within the modern knowledge society. Ethical ques- 
tions in current debates on science often revolve around the moral integ- 
rity of scientists, the ethical appropriateness of research projects and 
of their potentially harmful consequences.*! But this way of looking at 
ethics in science offers a different, or more limited, understanding than 
what the idea of ethos actually entails.** According to Robert Merton’s 
definition of “scientific ethos”, it includes epistemological principles, 
methodological advice, values and virtues, that together guide science 
and scientists, behavioral norms and institutional legitimizations: 


The ethos of science is that affectively toned complex of values and 
norms which is held to be binding in the man of science. The norms 
are expressed in the form of prescriptions, proscriptions, preferences, 
and permissions. They are legitimatized in terms of institutional 
values. These imperatives, transmitted by precept and example and 
reenforced by sanctions are in varying degrees internalized by the 
scientist, thus fashioning his scientific conscience or, if one prefers 
the latter-day phrase, his superego.* 


This concept of modern, collaborative science defines it not only as a 
systematically organized body of knowledge, but also as a distinct social 
process, influenced by communicative acts and collective sanctions, 
internal normative agreements and by a broader historical and social 
context. Consequently, social, political and ethical norms and values are 
considered essential constituents of science rather than external factors 
for evaluating the possible applications of science. In the end, science 
is neither value-neutral nor self-sufficient, but value-laden.** And as 
Merton emphasizes, such values, imperatives and principles constitute 
and legitimize norms of good scientific practice.* In this regard, science 
works just like any other institution, which extends self-organization by 
adding normative rules, institutionalized settings and an instrumental 
context of satisfying interests. Institutions thus represent normativity as 
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a result of a “process by which social processes or structures come to take 
on a rule-like status in social thought and action”.** Regarding scientific 
ethos, there are at least three levels. First, scientists collectively create 
binding norms for their profession. Second, these norms have retroac- 
tive effects on the self-identification of scientists. Third, norms are only 
accepted if they are institutionalized. Since scientists are also members 
of society, general social values influence scientific norms. Normativity 
and values are — occasional claims to the contrary notwithstanding — 
inherent in science. They define and structure what scientists should or 
should not do. By defining the settings of scientific (and social) practice 
and at the same time requiring compliance from scientists, evidence is 
part of the scientific ethos. 

To sum up: Scientific ethos is influenced by the institutionalized norms 
and values which are and have to be accepted by the majority of mem- 
bers of the scientific community. Hence, by stressing the importance 
of values and norms in science, the institutionalization of a scientific 
ethos is one key factor in the realization of science and its constitu- 
tive standards. Moreover, the scientific ethos serves as a guideline for 
the identity and self-confidence of scientists by creating the normative 
directives of science and the regulations of formal operations - and also 
the guiding ideas for understanding science as a profession. In addition 
to rational norms for the institutional search for truth, the ethos also 
contains social norms, including imperatives, rules of justification and 
proceeding, activity orientations, role expectations, virtues, reward and 
criticism systems.* The legitimatization of values and norms succeeds 
insofar scientists are willing to comply with them, even if they seem to 
be restrictive for their practice. Hence, the scientific ethos is not only the 
foundation but also the result of a jointly organized community, which 
leads to regulations, codices and guidelines that are created by scientific 
communities, universities and external funding sources.** 

What we have said on scientific criticism so far could be integrated 
into the concept of scientific ethos. Actually, one of the Mertonian 
norms is the principle of organized skepticism. This norm implies a 
reciprocal willingness on the part of the scientists to be open to criticism 
and possible adjustments. Such attitudes effectively serve as a stabilizing 
factor in science because they enable the critical participation of others 
in a collaborative setting. For Helen Longino, scientific criticism requires 
pluralistic views and approaches and can lead to consensual and secured 
knowledge. Criticism can lead to adjustments of a theory or other parts 
of scientific inquiry. It is part of a process-based and open science and 
may result in a Gestaltwechsel in the sense of a self-correcting science. 
Scientific criticism entails not only following rules, but also has the 
potential to influence and create epistemological and normative settings. 
In other words: Criticism defines and changes the knowledge and the 
environment in which science is embedded. 
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Now in what sense is evidence to be understood as part of the scientific 
ethos? We would once again highlight the close relationship between evi- 
dence and critique, but in a different way. For modern science, the creation 
and application of evidence are tied to specific production processes and 
practical uses. Pleas to evidence can be found during the process of survey- 
ing, evaluating and justifying scientific data. For example, the 18 century 
chemist Antoine Lavoisier ends his essay “Reflections on Phlogiston” by 
appealing to empirical evidence rather than speculative ideas.*? During the 
corona pandemic, pleas are also increasingly encountered in the political 
sphere, particularly when it comes to orienting political decisions toward 
scientific evidence.*° Scientists working in the natural sciences, humanities 
and social sciences describe how they understand the term evidence quite 
differently to one another.*! Examples range from the interpretation of 
evidence as empirical facts, as part of methodological practice or as a nar- 
rative strategy in science communication. Notably, evidence practices are 
also considered normative instructions on how science should be carried 
out. In this regard, evidence serves as an epistemological authority with 
legitimizing power. Evidence is rhetorically and epistemically connected 
with the criteria that determine the quality of science. Debates about 
basic principles can be bypassed by referring to evidence. Evidence can 
be directly anchored in the values of a scientific ethos. Evidence is a key 
factor in every scientific practice.*? 

We have argued so far that despite its interdisciplinary plurality, con- 
ceptual ambiguity and various epistemic, methodological and normative 
functions, the concept of evidence is crucial for science and its distinctive 
interactions and methods.* One of these methods is scientific criticism, 
whereby the wide range of meanings of evidence from epistemic claims to 
truth to indicators of usefulness makes it possible to criticize numerous 
aspects of scientific inquiry and outcomes. Nevertheless, existing evidence 
and criticism can be in both productive and inhibiting tension with each 
other. Following philosopher of science Thomas S. Kuhn, when “nature 
[...] fail[s] to conform entirely to expectation”, anomalies arise.** In a way, 
the rise of anomalies is par for the course in science. But under some cir- 
cumstances, anomalies can develop into a fundamental crisis or extraor- 
dinary new science.* Both the tension caused by everyday doubts about 
specific evidence and the revolutionary move toward radical new scientific 
practice are ultimately inherent in the project of modern science.** One 
reason why science is not entirely called into question by such criticism or 
even crisis lies, among other things, in the normative power the scientific 
ethos yields, of which the notion of evidence and evidence contestation 
is an integral part. Evidence, due to its ambivalent properties, provides 
possibilities for dynamic changes in scientific practice in a special way, 
as long as the principles of the normative setting are not questioned in 
their entirety. Evidence is thus quid facti both the result and equally the 
starting point for new scientific practices. To answer the question quid 
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iuris, that is, the question of the justified appeal to evidence by scientists, 
the perspective of agnosticism offers a starting point. The pre-rational 
decision for evidence is justified because the normative dimension of the 
scientific ethos generates, stabilizes, harmonizes and contests different 
registers and functions of evidence. At the same time, evidence is a pow- 
erful plea within science. Evidence is therefore a weighty reference in a 
scientific environment, which in turn is based precisely on such evidence. 
Evidence not only refers to the correctness of data or an appropriate pro- 
cedure, but also to shared norms and thus to an institutionalized self- 
image of science. 


On Contingencies, Crisis and the Sources of Stability in Science 


Organized skepticism and other norms of the scientific ethos, such as 
disinterestedness and universalism, are important sources for the pub- 
lic image of science as reliant and trustworthy. Hereby public trust is 
manifested in two ways: As general confidence in the self-regulating and 
self-controlling norms and practices of the scientific community and as 
a more specific epistemic trust in the validity and reliability of scientific 
expertise.“ The reverse is also true: Violations of the scientific ethos, as 
they have become known to a broader public through prominent cases 
of scientific fraud, undermine society’s trust in the sciences dramati- 
cally.** This means that the interaction between evidence and criticism 
manifested in the scientific ethos plays an important role in establishing 
scientifically produced knowledge as worth knowing, valuable and reli- 
able both internally, i.e. within the scientific community and externally, 
i.e. for society as a whole. The scientific ethos regulates scientific criti- 
cism and thus allows disapproval and dissent about evidence to become 
fruitful. But what about the possible contingencies that can arise from a 
pluralistic understanding of science, i.e. the existence and acceptance of 
diverse critical positions and interests? 

Contingencies normally refer to the possibility of something being 
different or that future events may or may not happen. This means that 
phenomenon A occurs, but it would also have been possible that A did 
not occur. For scientific predictions, contingencies seem to be a problem, 
because one cannot be absolutely sure that the prediction is correct, and 
this might conflict with the whole task of scientific inquiry. By providing 
alternative explanations and, at the same time, challenging the necessities 
of scientific insights, criticism can lead to contingencies. For science, this is 
a fundamental feature rather than a problem. But criticism is not the only 
factor that leads to contingencies: The ambiguity and openness of evi- 
dence can have the same effect. Again, from a philosophical perspective, 
this is not an issue: The ambiguity of evidence, which might be considered 
to be problematic from an analytic perspective, provides scientific practice 
with the means to produce knowledge and to address pluralistic insights. 
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The fact that evidence is not limited to a narrow range of meanings 
makes it an essentially contested concept — primarily for philosophers. 
What is important for us here is that the reasons why evidence can be 
considered a contested concept in the first place are to be understood as a 
key feature and practical value of evidence-claims in scientific processes. 
It is conceptual ambiguity that enables scientific progress and construc- 
tive communication by providing the possibility to dynamically adjust 
scientific practice. Due to its potential influence on general aspects of 
scientific practice (either intended or unintended), it guarantees the open- 
ness of scientific procedure without being arbitrary. It is ambiguous but 
not arbitrary because evidence itself ties scientific practice back to the 
scientific ethos. As evidence has an influence on the scientific ethos and 
can help determine the application of sanctions, it is used to demand 
compliance with standards. Evidence thus defines the standards and set- 
tings of scientific practice and therefore has a normative dimension. This 
is what we call its determining character as a powerful plea. 

At the same time, evidence does not refer to a single phenomenon. Or 
to put it differently: Obviously there are different scientific understand- 
ings of the concept of evidence. Therefore, the question as to why some- 
thing can be considered evidence can and probably must be answered 
differently. And these answers can and should not only refer to epis- 
temic aspects of scientific knowledge but also to the social, cultural, 
procedural, contextual, institutional conditions of science, which are 
integrated into the socio-epistemic normative structure of the scientific 
ethos. Science is, after all, a social phenomenon and a cultural practice.” 
Evidence is a constitutive part of a coherent social network of science 
in which references and legitimations among data, methods, reasoning, 
norms etc. take place. Consequently, the historians of science Moritz 
Epple and Claus Zittel note that “modern sciences, which have grown to 
social networks of substantial size, are not only shaped by the social and 
cultural condition under which they exist but also generate their own 
pattern of social and cultural behavior that tie in with the patterns of 
social life at large”.°° Karin Zachmann and Sarah Ehlers emphasize the 
dynamic negotiation process. This means for disputes about what counts 
as evidence, too, that they take place in a “web of competing, parallel, or 
constructive successive actions”.5l 

As we have seen, in general, the plurality and ambiguity of evidence 
and the contingencies that they may cause are not a problem for the plea 
of scientific evidence. Criticism is one way to contest evidence and can 
lead to contingencies which are just as much a part of science. Criticism 
is one key factor, firmly anchored in science, establishing new and old 
scientific standards for quality, reliability, objectivity and trustworthi- 
ness by connecting epistemic arguments while taking into account social 
practices and norms. Even if these criteria are not completely detached 
from societal developments (in parts they are even determined by them), 
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a certain independence of science develops, which is tolerated by other 
social subsystems such as constitutional law, which may legally guar- 
antee the autonomy of science and academic freedom.*? Criticism and 
contingencies can even stabilize science as long as scientists are willing to 
reflect on their own convictions and to acknowledge the possibility that 
things could be different. In our view, the ambivalent and plural func- 
tions and approaches of evidence offer precisely this scope for action. 

Obviously, criticism, contingencies and crises can act ina more destruc- 
tive way, so that they destabilize science and the public trust in scientific 
knowledge. As we have seen during the COVID-19 pandemic, not all 
participants in the public discourse acknowledge that evidence contes- 
tation is a key feature of science and that self-correction is not only nec- 
essary, but also progressive. Conspiracy theorists and general critics of 
scientific institutions, for example, treated corrections of research as an 
indication of the untrustworthiness and relativity of science, rather than 
understanding them as a mechanism of self-correcting science, which 
actually makes science more trustworthy, especially in times of crisis.’ 
The idea of “alternative facts”, to take a prominent example, is regres- 
sive with regard to the normative conditions of science criticism. They 
are completely opposed to the potential of being considered a fact at all. 
To be sure, this does not imply that there may be reasonable alternative 
opinions about the interpretation of given facts or evidence. General crit- 
icism of science typically ignores scientific standards and ethos-norms. 
This form of skepticism will normally not have productive effects for 
science — in most cases, it does not even intend to anyway. Therefore, it 
is hardly possible for such objections against science, in which evidence 
is highly valued, to be accepted as scientifically relevant criticism of sci- 
ence. Factually, the “argumentation” of skeptics or deniers of science is 
usually not oriented to facts or evidence at all, but to an underlying polit- 
ical agenda. Maybe the proper way to deal with such hidden political 
disputes about the impact and worth of scientific knowledge for politics 
should be political, too. 

Given the leading subject of this volume, we conclude that such gen- 
eral skepticism is not open to contingencies, because it claims to repre- 
sent an exclusive truth that does not allow for the possibility of things 
being different, including one’s own background assumptions.°* Thus, 
general skepticism about science does not fulfill the conditions of a prin- 
cipled openness to criticism as a crucial part of the scientific ethos. 


Notes 
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said they trusted science a lot increased by ten percentage points. See for 
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2 Questioning Evidence 
Three Modes of Contestation 


Eva Barlösius and Eva Ruffing 


In recent years, the validity of scientific knowledge and the adequacy of 
scientific expertise have been increasingly contested, which is why they 
are considered less trustworthy.! Thus, societal consent on the reference 
to scientific knowledge and expertise as best suited for adequate problem- 
solving - which is typical for knowledge societies — becomes more and 
more fragile. By increasing the fragility of that consensus, contestation 
spells trouble for the authority and legitimacy of scientific evidence 
within the political process. We argue that such an analysis is too crude: 
Scientific knowledge and scientific expertise are not always disputed; in 
the vast majority of cases, they are accepted without causing problems in 
making decisions. Furthermore, it is important that scientific knowledge 
and scientific expertise are challenged in a variety of ways, which is why 
the evidence attributed to them becomes fragile in various ways. 

In this chapter, we present a heuristic for distinguishing between three 
modes of contestation, highlighting for each the sort of difficulties it can 
cause for scientific knowledge and scientific expertise. These modes of 
contestation are the questioning of (1) the validity and reliability of sci- 
entific knowledge, (2) the extent to which the specific scientific expertise 
is adequate for solving the political problem at hand and (3) the scientific 
field’s exposed position in matters of decision- and policy-making and 
administrative processes. All three modes of contestation cause trouble 
for the recognition of evidence; in the first case, because the prerequi- 
site for evidence no longer persists; in the second case, by judging the 
claimed evidence as irrelevant; and in the third case, by the fundamental 
rejection of evidence. Whereas earlier publications of ours focused on 
approaches to handling these different modes of contestation,? we now 
emphasize the consequences of the contestation in terms of evidence. 

Scholars in science studies, political science, sociology and other dis- 
ciplines have been exploring the challenges to scientific knowledge and 
scientific expertise intensively for more than 15 years.’ Our review of 
the vast relevant research shows that the challenges have rarely been 
differentiated according to what exactly is in dispute or what the contes- 
tations are driving at. To fill this gap, we have developed a heuristic that 
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intertwines perspectives from the sociology of science, political science 
and administrative science.* Our heuristic rests on the observation that 
research on scientific knowledge and scientific expertise in the political 
and administrative process usually starts (depending on the scientific 
perspective) either from analyzing the genesis of scientific knowledge 
and its transformation into scientific expertise or from examining 
the role of scientific expertise in the political decision-making process. 
The heuristic we have developed, by contrast, makes clear that the var- 
ious forms of questioning are not differentiated along these lines, but 
rather according to what is being questioned in each case, and what the 
aim of the questioning is. 


Striving for Evidence 


Evidence has become a booming topic in science studies in the past few 
years. Key research areas are the requirements for scientific evidence’ 
and how evidence is produced and practiced.° Our research is inspired 
by Max Weber’s perspective on evidence. His conception allows us to 
observe the different challenges to evidence in the scientific and political 
fields and over the process of transformation to a knowledge society. 
It is not by chance that Weber began his famous work Economy and 
Society with a paragraph in which he spelt out how interpretive sociol- 
ogy produces scientific evidence, a term arguably translatable as “insight 
and comprehension”.’ As he puts it there, “all interpretation of meaning, 
like all scientific observations, strives for clarity and verifiable accuracy 
of insight and comprehension”.* Clarity and verifiable accuracy can be 
thought of as a means of generating evidence, which to Weber is “the 
basis for certainty in understanding”.” Although this phrasing shows 
that Weber interpreted the striving for evidence in a broad sense, includ- 
ing emotional, empathic, comprehensive personal convictions, values, 
norms or artistic ideas, he primarily had scientific evidence in mind. 

Weber regarded the scientific sphere as the social field with the “great- 
est and most principled” grade of rationality and with the highest degree 
of evidence.! To him, rationality and scientific evidence were nearly 
identical, and he was convinced that this kind of evidence would domi- 
nate in modern societies. Indeed, over the past 100 years, the value that 
societies attach to scientific evidence has increased enormously, and this 
importance has spread from the scientific field into almost all other social 
fields. It has permeated the decision- and policy-making community 
through scientific policy advice, especially in the form of scientific exper- 
tise. All other forms of evidence have waned in value, as ways of arriving 
at and justifying political decisions that are held to be problem-adequate 
and legitimate are judged by their basis in scientific evidence. 

With the diffusion of scientific evidence into nearly all social fields, the 
way it is understood has undergone great change. Within the scientific 
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field, Weber saw the quest for evidence as a process, and as the genera- 
tion of reliable and valid scientific knowledge. In this process, the meth- 
odological criteria of science and the requirements for validity, reliability 
and transparency have to be followed to generate scientific knowledge 
for which scientific evidence is recognized. Thus, scientific evidence 
emerges from the process of generating scientific knowledge, which is 
why we call it process evidence. Scientific knowledge is always to be 
considered preliminary, which equally applies to scientific evidence. The 
political use of scientific knowledge casts it as a scientific outcome and 
conceives it as fact having the highest possible degree of veracity and 
authority. The consideration of scientific outcomes as fact legitimizes 
scientific knowledge becoming the basis for political decisions. This 
shift in understanding and use of scientific knowledge involves a switch 
from process evidence to outcome evidence, which draws its clarity and 
verifiable accuracy from the point that scientific outcomes are consid- 
ered factual. 

This switch has coincided with a decline in the political value and 
relevance accorded to other forms of knowledge for decision-making. 
Instead, the difference between scientific knowledge and scientific 
expertise has become very important. Scientific knowledge and scientific 
expertise are difficult to define. They will be more precisely described in 
the following sections. Here, however, we discuss how they are related 
to evidence. Scientific knowledge draws its reliability from the scientific 
process. Douglas Walton and Nanning Zhang define scientific knowl- 
edge “as something that is achieved through a process of marshalling in 
a scientific inquiry”.!! Scientific expertise is based on scientific knowl- 
edge but provides Begriindungswissen (reasoning knowledge) from 
which political decisions are derived. Its evidence refers to its provision 
of adequate solutions for political problems. Scientific expertise ranks 
as the source of argumentation with both the highest degree of evidence 
and the highest degree of political authority and legitimacy. In the fol- 
lowing, we describe the three modes of contestation of scientific knowl- 
edge and scientific expertise and analyze the consequences they have for 
the recognition of the evidence they produce. 


A Critique of the Validity of Scientific Knowledge 


The first mode of contesting scientific evidence involves doubting the 
validity and reliability of the scientific knowledge on which scientific 
evidence is based and hence its evidence. Indeed, there are mounting 
claims that scientific knowledge is simply wrong.!? These challenges 
are convoluted; they essentially bark up the wrong tree by criticizing 
something to which science stakes no claim in the first place, at least no 
legitimate one. Scientific knowledge has no absolute validity; it is not 
100 percent reliable, and there is certainly no assertion that it proclaims 
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the truth. Rather, scientific knowledge differs from most other forms of 
knowledge precisely in that its validity and reliability derive explicitly 
from the state of research at a particular moment, and it is, therefore, 
always subject to review. At most, one can say that scientific know- 
ledge is only correct in a preliminary sense. It is to be regarded as a 
particularly reliable form of knowledge precisely because its validity and 
reliability are (ideally) constantly under question. Scientific scrutiny is 
not only about the tentative correctness of any scientific knowledge, but 
also about the existing and alleged gaps in knowledge and shortcomings 
in research. Additional gaps, it goes without saying, surface each time 
new knowledge appears, confirming the adage that research constantly 
raises more questions than it answers.!3 

The question of justified and unjustified claims of validity and reli- 
ability of scientific knowledge is a perennial focus of science studies. 
The question of scientific objectivity, for instance, was a concern of 
Max Weber's.!+ A similar question troubled both Karl Mannheim! and 
Ludwik Fleck!*, who asked whether it was possible to adopt a scientific 
standpoint that allows objective scientific observations. These authors 
came to more or less the same conclusion as Weber did, stating that 
such a scientific standpoint is difficult to access. Other studies of science 
have shown that the processes of generating knowledge are influenced 
by social, cultural, habitual and many other contextual factors, such 
as social structures, thinking styles, ethical and religious values, emo- 
tions and power, professional insecurity, as well as economic and legal 
restrictions.!7 

Alongside the limited validity and reliability of scientific knowledge, 
its context-bound nature has also provoked debate.'® None of these 
limitations stand for “incorrectness”, “inaccuracy” or “arbitrariness”. 
In order to count as scientific knowledge, a study has to conform to 
accepted standards of scholarly work in the relevant field of science at 
the time. These standards include the expectation that knowledge’s lim- 
ited validity, reliability and its context-bound nature will be pointed out, 
as well as the concomitant knowledge gaps and research deficits. 

The limited validity and reliability for which scientific knowledge is 
reproached in the first mode of contestation (meaning that it is only 
correct in a preliminary sense) are part of the “epistemological core” of 
the sciences and show therefore no deficiency.'? Scholarliness constitutes 
the framework of this type of inquiry. The manner in which scientific 
knowledge is questioned within that framework is a key characteristic of 
science, and is inscribed in the field’s nomos, that constitutes the specific 
nature of science itself and guarantees its continuation. This approach to 
questioning îs the scientific process." 

Such questioning is intended to dispute the correctness of scientific 
knowledge, but the standards of the scientific endeavor are not rejected 
in principle. Of course, these standards, too, must be examined and 
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readjusted again and again. On that score, scientific evidence runs into 
no trouble at all in the first mode of contestation.*! Following Weber, 
it can be said that it is a quest for evidence as a scientific process that 
includes perennial scientific contestation of the knowledge generated by 
the field. Consider an example to illustrate this nexus: If toxicological 
research finds higher residues of an environmental toxin, such as glypho- 
sate, than previously, thanks to new detection methods, this result is a 
new scientific outcome, but it does not call into question the criteria for 
its scientific character. However, this shows that scientific knowledge, 
which serves as the basis for scientific expertise, has to meet particularly 
high requirements in terms of validity and reliability. 

Researchers in science studies have proposed ways to improve the 
validity and reliability of identifying and characterizing scientific knowl- 
edge. Bruno Latour, for example, introduced the distinction between 
science faite (science made) and science en train de se faire (science in the 
making), the former being scientific knowledge that is solid, or cold, and 
the latter being new.” To Latour, “science in the making” represents 
new research results, which are too hot and risky to be taken as a basis 
for scientific expertise. In contrast, solid or cold scientific knowledge 
has been tested many times and in many different ways and has proven 
to be coherent and consistent with other bodies of knowledge, as in the 
context of meta-studies. An example for demonstrating the robustness 
of scientific knowledge by a meta-study is the famous research letter 
“Consensus on Consensus: A Synthesis of Consensus Estimates on 
Human-Caused Global Warming” written by 16 scientists who analyzed 
2,412 papers on global warming.” They found a 97 percent consensus 
on global warming in the scientific articles, which represents a highly 
robust scientific outcome. 


Contesting Evidence in the Context of the Decision- and 
Policy-Making Communities and Administrative Actors 


Criticizing Problem Adequacy 


The second mode of questioning evidence is to cast doubt on what is 
known as the problem adequacy of scientific expertise, that is, the ability 
and suitability of such expertise to address or solve a given problem in 
decision-making on political and administrative matters.”* At stake is 
the way in which that expertise has been processed and used by deci- 
sion makers.?5 The question here is not so much whether the expertise 
is based on knowledge that is right but whether the right expertise has 
been used, taking into account the fact that policymakers might disagree 
about roots and possible solutions of policy problems, and therefore also 
about the question of which expertise is most adequate to solve the prob- 
lem at hand. To differentiate between scientific knowledge and scientific 
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expertise, we adopt the view taken by philosopher of science Philippe 
Roqueplo, to whom the essential difference is that scientific expertise is 
underpinned by a rationale (connaissance de cause) and thus aims less 
at explaining and understanding than scientific knowledge does.?* To 
Roqueplo, what transforms “the utterance of scientific knowledge into 
expertise is its inscription within the dynamics of decision making”.?’ 
Above all, scientific experts are obliged to answer questions posed by 
politicians and administrators.”® We add another serious difference: 
In making the transition to scientific expertise, scientific knowledge 
becomes politically framed as well. 

By political framing, we mean that in practice problems are pro- 
cessed in policy domains, each of which is characterized by different 
constellations of actors and conflicts, political models and a stock of 
institutional regulations that influence politico-administrative action,” 
though different policy domains and problems are also intertwined.*° 
Often, separate and distinct administrative structures — a domain’s own 
ministry and authority — are constituting elements of a policy domain.*! 
However, policy fields cannot necessarily be clearly delineated, which is 
why political problems can, in principle, be assigned to different ones. 

The framing of the particular problem determines the policy domain 
to which it is assigned, the department that is given responsibility for 
it, and the research field from which scientific knowledge is sought 
as expertise. Glyphosate, for example, can be politically framed as a 
problem of health, nature conservation or food. Depending on which 
understanding of glyphosate prevails, separate departments become 
responsible for obtaining scientific expertise from medicine, biodiversity 
research or nutrition science. 

However, these sciences look at glyphosate from very different 
research perspectives, develop correspondingly different test criteria 
and detection methods and, when asked for scientific expertise, come to 
different conclusions on the hazards and risks of this substance. None 
of the procedures or criteria is scientifically more correct than another. 
Rather, they result from the different scientific approach that each field 
takes to the problem. Accordingly, the reports by scientific experts con- 
centrate on different impacts, propose different permissible levels and 
usually do not arrive at unanimous and unambiguous overall assess- 
ments, some of which are even contradictory. The inconsistency of the 
results is therefore not due to an insufficient quality of scientific evi- 
dence, nor to its limited validity and reliability; the lack of uniformity by 
no means results from insufficient scientific evidence. Rather, different 
political frameworks bring different kinds of scientific expertise to bear, 
each of which specializes in different consequences. 

The second mode of contestation takes place within a political frame- 
work involving various kinds of scientific expertise. As already pointed 
out, this form of questioning takes aim at the problem-solving adequacy 
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of that expertise and casts doubt on it. We distinguish three variants in 
challenging this adequacy and identify the transitions between the first 
and the second, in particular. In the first variant, proponents of counter- 
expertise accumulate knowledge other than that cited by the scientific 
expertise initially presented. In the second variant, the political framing 
is criticized as inappropriate. The point of the third variant is to contest 
the adequacy of scientific expertise in general to justify a specific politi- 
cal decision. These three possibilities for questioning scientific expertise 
are explained in more detail below. It is important to note, however, 
that none of them fundamentally questions the relevance of scientific 
expertise for decision makers. The second mode of contesting evidence 
is merely a dispute about whether the politically and administratively 
used scientific expertise is adequate for problem-solving — whether it is 
correctly framed politically. The third variant is a dispute of whether it 
is a political problem that should be “solved” on the basis of scientific 
expertise. This is where the insight and understanding offered by scien- 
tific expertise runs into trouble, not because it is said to be wrong, but 
rather because it is the wrong sort of expertise to solve the identified 
problem. The problem adequacy of the expertise is assessed in light of 
the policy problem’s political framing. This juncture is where the afore- 
mentioned switch from process evidence to outcome evidence comes in, 
as the scientific results are assessed according to whether they provide an 
adequate basis for decision-making and administrative action. 


Contestation through Counter-Expertise 


A typical strategy by which to challenge scientific expertise is to estab- 
lish scientific counter-knowledge and counter-expertise based on it. 
Opponents of one expertise advocate new research methods and topics, 
and often a completely different view of the problems. Transdisciplinary 
and socioecological research are examples of the creation of other modes 
of research not commonly found in the established sciences. Topics 
that have not been studied in the established sciences or that have been 
researched too little and, often, one-sidedly, include issues of gender, 
diversity and sustainability. Opponents of established research often help 
to draw attention to these gaps and shortcomings, by building grounded 
knowledge and expertise that runs counter to the mainstream. For this 
purpose, they often establish their own scientific institutions, such as 
the Oko-Forschungsinstitute (Eco-Research Institutes) in Germany in 
the late 1970s.% It is not always the primary goal of these opponents to 
advance scientific research. Instead, the focus can also be to underpin 
their own political position scientifically. 

In this variant of questioning, scientific expertise meets counter- 
expertise, but across these divides, there is widespread agreement 
that political and administrative decisions should rest on scientific 
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knowledge, and that they derive legitimacy on that basis. The dispute 
is over what kind of scientific knowledge is adequate for the problem- 
solving that forms the basis of political decisions and administrative 
action. Scholarliness and scientific expertise are not fundamentally crit- 
icized or rejected as tools of policy-making and administrative action. 
Even the arguments rooted in counter-knowledge and counter-expertise 
acknowledge that scientific knowledge and scientific expertise are the 
basis for objectively adequate, problem-solving, political and adminis- 
trative decisions. The disagreement is about the evidence of the scien- 
tific knowledge used for the expertise, as it is said to arrive at results 
(outcomes) that may be scientifically correct, but not suitable for sol- 
ving the identified political problem. The scientific knowledge used by 
policy- and decision makers and administrative actors is contrasted with 
other scientific expertise for which scientific evidence is also claimed, 
but which is said to be more adequate for problem-solving, and which 
therefore possesses a higher level of evidence. 

Sticking with the example of glyphosate, the following example 
illustrates how contestation is expressed via counter-expertise. The 
European Food Safety Authority (EFSA) was commissioned to apply its 
scientific expertise to the prolongation of the authorization of glypho- 
sate. Based on its own risk assessment, the EFSA proposed the renewal 
of the license for the pesticide to the European Commission (EC).5* The 
International Agency for Research on Cancer (IARC), which is part of 
the World Health Organization (WHO), also assessed glyphosate. Its 
report came to the conclusion that glyphosate is “probably carcinogenic 
to humans”.35 The EFSA was asked to review the IARC report but came 
to the conclusion that there is no causal link to cancer. The different 
assessments have a number of reasons, and a particularly important one 
is that the EFSA and the IARC were looking at the same phenomenon 
from different scientific perspectives: The EFSA viewed glyphosate as a 
food risk and analyzed pesticide residues, whereas the IARC considered 
the pesticide as a health risk and examined whether it could potentially 
cause cancer in an organism. 


Contestation through Problem-Shifting 


Another typical strategy for questioning the objective adequacy of scien- 
tific expertise is problem-shifting - the denial that the problem has been 
properly framed, assigned to the appropriate policy domain and handed 
over to a suitable department, regardless of how the problem is compre- 
hended. As a result, it is argued that scientific expertise that is suitable 
to solve the problem has not been used. This criticism aims at a political 
shift of the problem to a different policy domain and/or different depart- 
ment, a change that then justifies the recourse to other scientific exper- 
tise and, if necessary, buttresses one’s own political position.* Shifting 
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the problem can mean basing scientific expertise on research knowledge 
from other sciences or other fields of research. These other scientific per- 
spectives may arrive at considerations and assessments that diverge from 
the previous scientific presentation and evaluation. In the case of glypho- 
sate, a very powerful contestation occurred by problem-shifting how 
harmful the pesticide is from agriculture and food policy to environmen- 
tal policy, and by using biological expertise to prove how dangerous it 
is for biodiversity. 

However, the questioning inherent in problem-shifting does not allege 
inadequacy of the knowledge being brought to bear, but rather of the 
problem’s political framing. In other words, it criticizes the evidence by 
which the problem addressed was assigned to a particular policy domain, 
and by which scientific expertise was duly commissioned. In the political 
process, however, this remonstration is often argued as though it were 
about a lack of scientific evidence, though in fact this dispute is about 
inconsistencies between scientific expertise from different disciplines, 
which results from the diverse research perspectives. In this case, too, 
the reasoning is based on outcome evidence. 


Contestation through Questioning the Ability to 
Solve a Specific Problem 


A characteristic of the third variant of questioning evidence within the 
second mode is that a particular problem cannot be solved through 
scientific expertise alone. However, this feature in no way implies a 
fundamental rejection of the significance and importance of scientific 
expertise in the political process. As with the two other variants, it is 
acknowledged in principle that scientific expertise can contribute to ade- 
quate solutions to problems. The aim in this third variant of its critique 
is to keep scientific expertise from being used to decide politically con- 
tentious matters, or to cover them up scientifically. The main thrust of 
the argument is that conflicting interests and/or differing preferences 
give rise to the dissent. 

In this variant of questioning, the criticism is that decision makers, 
policymakers and administrative actors should not use scientific evi- 
dence to bypass political dissent. In this case, too, scientific evidence 
runs into less trouble than do the decision-making, policy-making and 
administrative communities, which end up being confronted by diver- 
gent political views. The criticism is that political trouble is deliberately 
disguised or obfuscated with scientific evidence. For instance, the pro- 
test group called the Yellow Vests in France agreed with the scientific 
analyses that glyphosate is bad for biodiversity, and that the use of 
these pesticides should be reduced.*” They protested against the scien- 
tific expertise exhibited by the French National Institute for Agriculture 
(INRA), which recommended that the farmers and winegrowers revert 
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to using weed hooks.* The protestors pointed out the collision of con- 
flicting interests: Elite Parisians were talking about the end of the world, 
while the farmers and winegrowers who were in economic difficulty 
were talking about the end of the month. 


Criticism of the Social Position of Science 


The third mode of contestation arises from the transformation to a 
knowledge society, and the accompanying societal upheavals, especially 
socio-structural ones. It is thus not enough to simply state that such 
inquiry fundamentally questions the relevance of scientific knowledge and 
scientific expertise for political and administrative decision-making. At the 
same time, this mode of contestation is driven by discontent about the posi- 
tion science has acquired in society, and the authority it has been granted. 
This third mode of contesting scientific expertise opposes the idea that 
the adequacy of political and administrative decisions can be measured by 
whether existing scientific knowledge has been taken into account. Thus, 
it rests on an objection to what in modern societies is the typical coupling 
of science and politics as established through scientific expertise. It is a 
linkage intended to guarantee that “all accessible knowledge about the 
relevant subject area is used and taken into account” in decision-making, 
in order to arrive at appropriate and expedient solutions.*” 

The relationship is designed to give scientific knowledge priority over 
other ways of knowing and other forms of epistemological content. 
However, it certainly does not mean that this priority is always, or even 
predominantly, conferred in political and administrative practice. The 
third mode of contestation questions the direct coupling of scientific 
knowledge and political decision-making. The argument against this 
coupling is that scientific knowledge is assigned with authority and legit- 
imates power in decision- and policy-making and administrative action, 
allegedly enabling scientific evidence to rule in those spheres. 

In recent years, various labels have taken root in common parlance 
to characterize the way scientific knowledge is typically handled in 
the third mode of contesting scientific expertise. These include “post- 
truth”,*® misinformation and conspiracy theories. These labels make 
clear that something incorrect, false and erroneous is being dissemi- 
nated. They characteristically delegitimize an argument before it is even 
formulated, always implying in advance that “the view thus designated 
is wrong”.*! Their counterpart in some places is “Trotzpositivismus”,*? 
which may be translated as “defiant positivism”, the message of which is 
“for alternativeless facts, for scientific evidence, for truth in politics”.* 
These extremes clearly reveal a typical fault line running through the 
knowledge society, as the more scientific expertise is used to explain 
and justify political and administrative action, the more it becomes the 
subject of social and political disputes. 
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With the validity and reliability of scientific knowledge, as well as the 
problem-solving adequacy of scientific expertise, which is always under 
scrutiny, and with scientific knowledge having no inherent claim to 
truth, the third mode of contesting scientific expertise encounters a sort 
of “institutional” doubt, which it escalates into a matter of principle. 
However, the accusation that science spreads untruth should not be mis- 
construed as denial of the validity and reliability of scientific knowledge. 
The reproach is instead aimed at the power of authorization that science 
has in the knowledge society.** 

Previous studies on “Post-Truth”* and misinformation identify three 
main reasons for the success of the third mode of contesting scientific 
expertise. One of them is the special position of science in the knowledge 
society, which is the basis for the cultural, political and social supremacy 
of those who work in the field of science and speak for it to the out- 
side world as experts: “Public dismissal of science, or public distrust of 
experts should be seen in the context of public discontent with authori- 
ties and elites that exert power over citizens’ lives”.*° These disputes are 
less about the validity and reliability of scientific knowledge than about 
criticism of politics and society. 

A second reason for the enormous success of the third mode of con- 
testing scientific expertise seems to be that political decisions are often 
presented “without alternative” with reference to scientific expertise. 
The aim of circulating opposing “alternative facts”, denouncing scien- 
tific findings as untruths, and spreading deliberately false statements of 
fact is less to lend them recognition and practical effectiveness than to 
bring about new rules of the game for public discussions.* Axel Freimuth 
argues similarly: “scientific results are often used to identify political 
[and other] decisions as having no alternative”.* This viewpoint figures 
in Jan Söffner’s analysis that such representations often come across as 
though there were a discourse of truth, accessible only to experts, which 
is encroaching on the field of political decision-making.* He argues that 
the opinion-formation that used to take place is now often supplanted by 
factual analysis only. Such a purely technocratic use of scientific exper- 
tise contributes to the emaciation of political and administrative pro- 
cesses. In the political science debate, representatives of the so-called 
agonistic theory of democracy criticize this use of scientific expertise and 
call for repoliticization in the sense of a stronger emphasis on conflict 
resolution within the framework of democratic processes.‘ 

Increased social fragmentation and exclusion are the third rea- 
son for the success of contesting scientific expertise by challenging 
scientific expertise’s exclusive ability to solve identified problems. The 
social groups affected by social fragmentation and exclusion will seek 
to make themselves heard by means of such questioning.*! They feel 
powerless, fear downward mobility and perceive themselves as disad- 
vantaged. They also feel exposed to pressures that are highly normative 
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socially and culturally. Consequently, both the public rejection of scien- 
tific knowledge and the publicly articulated mistrust of scientific experts 
must be understood in the context of real and perceived socio-structural 
discrimination. 

If these three reasons correctly describe the core of the controversies, 
the third mode of contestation represents a dispute over the manner in 
which the relative positions of politics and science should be determined, 
and the extent to which scientific expertise should be a part of decision- 
making. Furthermore, this is apparently a socio-structural struggle 
against the way in which science and the decision-making, policy-making 
and administrative communities are entangled with social elites and the 
resulting power of authorization. It is a question of the relevance of scien- 
tific evidence to the decision-making, policy-making and administrative 
communities. The argument is that certain social groups seek to have 
the primacy of scientific evidence recognized, and that favoring this kind 
of evidence enables them to use their social positions to exercise power. 
Argumentation with scientific evidence and the coupling of science and 
politics is thus declared to be in the interest of certain socio-structural 
groups. It is not accepted as the best option for arriving at justified and 
effective political decisions. The causes underlying both the third mode 
of contesting scientific expertise and knowledge as a basis for guarantee- 
ing appropriate consideration of political solutions extend far beyond the 
validity and reliability of scientific knowledge and scientific expertise. 


Conclusion 


Our chapter has presented a heuristic for systematically describing the 
different modes of questioning scientific knowledge and scientific exper- 
tise, by elaborating their causes, and discussing their consequences for 
the accepted reliability of scientific knowledge and expertise. As we have 
seen, the first mode starts from scientific knowledge and casts doubt 
on its certainty. However, this kind of doubt is inscribed in the under- 
standing of scientific evidence as a methodologically conducted process 
oriented toward generating valid scientific knowledge in a transpar- 
ent manner. According to its basic understanding, scientific results are 
always preliminary, and the validity and reliability of scientific knowl- 
edge are to be regarded as tentative. 

In the second mode of contestation, politically and administratively 
produced and asserted evidence is the focus of criticism. The criticism 
derives primarily from the political and administrative framing of 
the problem, which is objected to as unsuitable for solving the policy 
problem at hand. This objection shows that the understanding of what 
is certain in the political and administrative process is not identical to 
what is taken to be certain or well-founded in the context of research. 
On the one hand, the argument is based mainly on outcome evidence, 
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which means to take scientific knowledge as fact, and to make it the 
basis for scientific expertise. On the other hand, framed evidence is used 
in the political and administrative process to establish legitimacy for 
solutions to certain problems. 

The third mode of contestation denies that scientific evidence guaran- 
tees a high degree of validity and reliability. It thus rejects the coupling 
of scientific evidence and politico-administrative decisions. Reasoning 
on the basis of scientific evidence is not seen as a procedure for arriving 
at the most acceptable solutions, but rather as a typical means by which 
social elites exercise power. This development marks the end of societal 
consent to basing political and administrative decisions in a rational and 
problem-adequate way on expertise. Drawing on Max Weber, one can 
say that this mode of contestation breaks with society’s typical quest for 
scientific evidence and rationality, resulting in broken evidence. 

One could assume that the three forms of contestation clearly indi- 
cate that actors no longer trust the validity of scientific knowledge and 
scientific expertise. However, as argued above, the evidence of scientific 
knowledge and scientific expertise are hardly contested in the majority 
of cases. In contrast, we observe two phenomena in parallel: Trust and 
mistrust in scientific evidence. The COVID-19 pandemic serves as an 
instructive example. On the one hand, “hot” scientific knowledge on 
the virus was eagerly awaited, as well as the newly developed vaccines 
and the policies that rested on that hot knowledge, which were conse- 
quently applied in daily life. On the other hand, mistrust in this type of 
science-led policies grew. The existence of COVID-19 was denied, vac- 
cines were believed to carry higher risks than the virus and the policies 
for controlling the pandemic were seen as harbingers of an autocratic 
turn. These forms of denial and the resulting clashes are a manifestation 
of socio-structural and political struggles and belong to the third form 
of contestation in our heuristic. These struggles are not about question- 
ing the evidence of scientific knowledge, but rather a dispute about how 
political solutions come about. 


Notes 


1 This chapter builds on two previous publications (Eva Barlésius and Eva 
Ruffing, “Für einen vorausschauenden Umgang mit der Infragestellung 
wissenschaftlicher Expertise”. Impulspapier, Institutionelles Reposito- 
rium der Leibniz Universität Hannover, (2020); Eva Barlösius and Eva 
Ruffing, “Die Infragestellung von wissenschaftlichem Wissen und Exper- 
tise: Eine sozialwissenschaftliche Heuristik”, Sonderband Leviathan 38 
(2021): 113-134). Here we analyzed the consequences of the three modes 
of contestation of scientific knowledge and expertise for political and 
administrative decision-making. The heuristic of the three forms of contes- 
tation was developed during our research project on “Scientific Expertise 
as Basis for Political Decision-Making”, https://www.lcss.uni-hannover. 
de/de/forschung/unsere-forschungsprojekte/mwk-projekt-wiss-expertise/. 
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3 How Many Plots Can the Data 
Hold? Reconciling Stories and 
Evidence in Evolutionary Biology 


Martha Kenney 


The universe is not only queerer than we suppose, 
but queerer than we can suppose. 
- J.B.S. Haldane 


This is a chapter about the sometimes uneasy, often generative relation- 
ship between storytelling and scientific evidence. As a feminist science 
studies scholar, I argue that we not only need to critique politically 
charged narratives lurking in scientific knowledge claims, but, in order 
to tell better stories about the world, we must embrace storytelling as 
an important component of scientific practice.! In an era characterized 
by the unprecedented circulation of fake news, disinformation, science 
denialism and conspiracy theories, this might feel like a dangerous prop- 
osition. Writing from the United States in late 2021, where 30 percent 
of adults are still not vaccinated for COVID-19, it seems particularly 
urgent to separate scientific fact from fiction, opinions or “just stories”. 
However, this stark opposition between meaning, esthetics and subjec- 
tivity, on the one hand, and facts and objectivity, on the other, is funda- 
mentally an artificial distinction. Although it may be epistemologically 
comforting, it is impossible to banish socially and culturally situated 
forms of meaning-making from our knowledge-making practices. As 
feminist philosopher Helen Longino argues, background beliefs, which 
include the narrative substrate of scientific inquiry, are, in fact, “an ena- 
bling condition of the reasoning process” and therefore intrinsic to sci- 
entific inquiry.” 

In this chapter, I argue that stories and storytelling are not the enemy 
of empiricism and are often at the heart of generating both evidence and 
evidence criticism. In particular, attention to stories can help us contest 
established orthodoxies in the natural sciences and stimulate new avenues 
of empirical investigation. To build this argument, I draw on the work 
of philosopher Isabelle Stengers, who argues for the importance of call- 
ing dominant scientific narratives into question in order to create what 
Donna Haraway has characterized as “a more adequate, richer, better 
account of a world”.? Stengers writes: “I am convinced we need other 
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narratives, narratives that populate our worlds and imaginations in a dif- 
ferent way”.* Importantly, for Stengers, this call is not in opposition to 
empirical inquiry but in the service of a more capacious empiricism that 
actively resists “explaining away what would complicate our judgement”’ 
and is capable of contesting received categories and explanations. She calls 
her philosophical proposition, “a materialism without eliminativism”. 

In what follows, I briefly outline Stengers’s materialism without 
eliminativism and then turn to the work of evolutionary biologist Joan 
Roughgarden to illustrate this proposition, paying particular attention 
to the relationship between story and evidence in Roughgarden’s books 
Evolution’s Rainbow (2004) and The Genial Gene (2009) as well as her 
many articles. This central case study is based on a literature review of 
Roughgarden’s scientific and popular work critiquing sexual selection, 
as well as reviews of Roughgarden’s books by evolutionary biologists and 
the evolutionary biology literature that has since cited Roughgarden. I 
outline the controversy her critique of sexual selection garnered and how, 
despite her even-handed and empirically grounded defense of her work, 
Roughgarden’s proposal has largely been dismissed by her colleagues in 
evolutionary biology. Honoring the intimate relationship between nar- 
rative and evidence in Roughgarden’s work, I conclude by offering the 
speculative question, “How many plots can the data hold?” as a prov- 
ocation to embrace storytelling as an active part of scientific practice, 
and to open up new pathways of narration, relation and investigation in 
evolutionary biology and beyond. Finally, I provide a short epilogue to 
demonstrate how the arts and humanities, in this case poetry, can help 
generate promising alternatives to dominant biological narratives. 


Materialism without Eliminativism 


In “Diderot’s Egg: Divorcing Materialism from Eliminativism”, Isabelle 
Stengers argues for a demanding materialism, a materialism that can 
explain “how, with matter, we get sensitivity, life, memory, conscious- 
ness, and thought”.° She tells the story of French philosopher Denis 
Diderot, who produces an egg and declares, “Do you see this egg? With 
this you can overthrow all the schools of theology, all the churches of the 
earth”.” Stengers argues that Diderot’s egg not only offers a materialist 
challenge to theology, but also a challenge for materialists to embrace a 
concept of matter that can account for complex phenomena: “The chal- 
lenge of the egg points to what is required from the egg in order for the 
development of the chicken not to be a miracle”.5 Stengers imagines a 
materialism capable of causing wonder, surprise and alarm — a material- 
ism that affirms that there are more things in heaven and earth than are 
dreamt of in our philosophy, to paraphrase Hamlet. 

Stengers’s proposition is not only philosophical and empirical, 
but also political. She argues that we must divorce materialism from 
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eliminativism in order to connect materialism with worldly, political 
struggle. A materialism without eliminativism would not use the decree 
“science says” to shut down controversy but would embrace an empiri- 
cism that can actively contest “what matters and what is excluded from 
mattering”.? Stengers gives the example of debates over genetically mod- 
ified organisms (GMOs), where “the certainties of lab biologists silenc[e] 
those colleagues who work outside of the lab and ask different and per- 
plexing questions”.!° She characterizes Vandana Shiva’s anti-GMO cam- 
paigns for food sovereignty in the Global South, in part, as a demand 
for “a relevant science, a science that would actively take into account 
the knowledge associated with those agricultural practices that are in 
the process of being destroyed in the name of progress”.!! Shiva’s claims 
are often subject to scientific “debunking” on behalf of powerful actors 
such as Monsanto; Stengers yearns for a science capable of supporting 
activists like Shiva, rather than powerful, settled interests such as cor- 
porate global biotech. A materialism without eliminativism would be 
capable of unsettling the status quo and challenging a “closed definition 
of a rational science”.!? 

In the face of this definition of matter, a matter that always exceeds 
our ability to capture it, we need a more capacious understanding of 
empiricism, an empiricism where we can open up the question of what 
counts as evidence and ask what other stories about the natural world 
are possible. 


Joan Roughgarden’s Alternative to Sexual Selection: 
Social Selection 


To illustrate the intimate relationship between story and evidence in a 
materialism without elimativism, I turn to evolutionary biologist Joan 
Roughgarden, Professor Emerita at Stanford University in California. 
Her work is particularly exemplary of a methodology that is simulta- 
neously narrative and empirical. In her 2009 book The Genial Gene, 
Roughgarden boldly critiques Darwin’s theory of sexual selection as 
“inadequate to address the diversity of bodies, behaviors, and life his- 
tories that actually exist [in nature]”.!3 The theory of sexual selection, 
which Darwin presents in The Descent of Man and Selection in Relation 
to Sex (1871), seeks to explain ornaments and armaments such as a 
stag’s antlers or the bright feathers of a peacock’s tail that do not appear 
to enhance survival. Instead, Darwin argues that these traits bestow a 
reproductive advantage. As males compete for access to females, females 
choose to mate with males who have the best example of that trait and, 
therefore, over time, it is selected for in the population at large, despite 
causing, for example, an increased risk of predation due to heavy ant- 
lers or colorful plumage. As Darwin argues, the peahen’s “continued 
preference for the most beautiful males, rendered the peacock the most 
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splendid of living birds”.!* Today, sexual selection remains the central 
theory for explaining ornaments and armaments and other traits arising 
from competition for mates.!* In many Neo-Darwinian accounts, male 
ornaments are considered indicators of the genetic quality of males; the 
elaborateness of the peacock’s tail can be seen as advertising his “good 
genes” to potential mates.!® 

While there are many species that do not conform to this template, 
this preponderance of evidence has not been seen as a challenge to sex- 
ual selection. For example, not all species of birds have bright males 
and cryptic females; there are many sexually monomorphic species such 
as the emperor penguin, in which biologists cannot identify the differ- 
ence between males and females without examining their sex organs. 
Similarly, males do not always compete for access to females; there are 
species, where females solicit males for sex, such as the alpine accen- 
tors. However, these species are cast as outliers that do not challenge 
sexual selection itself but can be accounted for with some small amend- 
ments; the alpine accentor, is considered a “sex-role reversed” species, 
an exception that seemingly proves the rule. However, as Roughgarden 
points out, these species are not seen as challenging the central narra- 
tive of sexual selection: “Sexual selection advocates resist a critique that 
emphasizes what they regard as exceptional species, because such a cri- 
tique ignores the supposedly many cases in which they claim the sexual 
selection narrative is correct”.!” 

For this reason, Roughgarden’s critique of sexual selection not only 
enumerates the many outliers, but also returns to the species that seem 
to conform most with the Darwinian template. Roughgarden goes back 
into the most potent fables of sexual selection and retells them, looking 
for alternative hypotheses that explain the trait or behavior in question. 
In the first chapter of The Genial Gene, she revisits the peacock, the 
textbook example of sexual selection. Here, Roughgarden offers an 
alternative account of peacock evolution proposed by a team of Japanese 
researchers who found, in a six-year study of 105 free-ranging Indian 
peafowl, that peahens do not, in fact, prefer peacocks with more elab- 
orate tails. Takahashi et al. provide an alternative evolutionary expla- 
nation for their results that directly contradicts the Darwinian account 
in which both peacocks and peahens were originally drab and the pea- 
cock became bright through sexual selection.'® In this new story, it is 
the reverse: Both males and females were originally brightly colored. 
However, since females were more vulnerable to predation while incu- 
bating eggs, their coloring became more cryptic over time due to natural 
selection, while the males remained bright. This new explanation is sup- 
ported by evidence from their study, which found that despite their cryp- 
tic coloring females were twice as vulnerable to predation than males. 
They also cite other studies that show that bright plumage color in galli- 
form birds like the peacock is inhibited by estrogen, suggesting that the 


How Many Plots Can the Data Hold? 83 


cryptic coloring of the female is the more recently derived trait. When 
sexual selection could not account for the empirical evidence collected 
in this peacock study, there was a narrative opening: What can account 
for this phenomenon if not sexual selection? Is there evidence to support 
a different story? 

The findings from Takahashi et al. raise a larger evolutionary ques- 
tion: Why do peacocks continue to have brightly colored plumage, when 
brightly colored plumage is more likely to lead to predation? Roughgarden 
suggests an alternative hypothesis. Rather than communicating infor- 
mation about a male’s “good genes” to potential mates, Roughgarden 
suggests that brightly colored tails act instead as “admission tickets to 
power-holding cliques that control the resources for successful rearing of 
offspring”.!? In Roughgarden’s account, bright tails are part of a wider 
set of “social inclusionary traits” that not only consist of physiological 
traits that serve social functions, but social behaviors like grooming that 
promote teamwork among individuals. This new story is about main- 
taining the social structure to successfully rear young; here behaviors 
such as teamwork emerge as evolutionarily significant, in opposition to 
the Darwinian story that always centers reproductive success. 

Roughgarden’s peacock story is one illustration of “social selec- 
tion”, the theory that she has devised to replace sexual selection. Social 
selection is defined as “selection for, and in the context of, the social 
infrastructure of a species within which offspring are produced and 
reared”; here evolutionary success is defined not as individual repro- 
ductive success but is based on the number of offspring that are reared 
into the next generation. When we pay attention to the social structure 
in which offspring are produced and reared, mating is no longer a priv- 
ileged behavior; rather it constitutes one “reproductive social behavior” 
among many: 


Social selection views reproductive social behavior as comprising 
an ‘offspring-rearing system’. Within this system, natural selec- 
tion arises from differences in the number of offspring successfully 
reared, and particular behaviors are understood by how they con- 
tribute to building, or maintaining, the social infrastructure within 
which offspring are reared.*! 


Within this framework, animal behaviors that are poorly accounted for 
by sexual selection, such as same-sex sexual behavior, become intelli- 
gible as reproductive social behavior. Sexual selection explains away 
same-sex sexual behavior by claiming it is “an inadvertent mistake, a 
deception, or a deleterious trait”;?? in social selection, same-sex sexual- 
ity is a reproductive social behavior that promotes intimacy and team- 
work,” therefore strengthening the social infrastructure within which 
offspring are reared. 
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While Roughgarden believes social selection offers a better account 
for the morphology and behaviors of animals than sexual selection, 
she ultimately argues that empirical inquiry should be privileged over 
her narrative instincts. Throughout The Genial Gene, Roughgarden 
emphasizes the need to work against confirmation bias in evolutionary 
biology and to test multiple hypotheses. She writes: “I can’t overem- 
phasize enough that evolutionary theories, like theories in any other 
area of biology, such as molecular biology, genetics, and physiology are 
destined for testing”.2* Roughgarden presents social selection not as a 
complete or confirmed theory, but a set of hypotheses to be proven. At 
the end of The Genial Gene, she writes: “Time will tell whether social 
selection is indeed correct or whether some substantial modification or 
third approach is needed”. The Genial Gene is an invitation for more 
hypotheses about evolutionary biology that can account for the sheer 
diversity of social behaviors and physical traits in the natural world. 
“The welcoming door is open”, she concludes, “come on in”.26 

Described this way, Roughgarden’s argument does not, at first, appear 
controversial. Indeed, it is firmly rooted in a conventional understanding 
of scientific rigor: Review evidence in the existing literature, test addi- 
tional hypotheses, avoid confirmation bias, publish both positive and 
negative results, consider alternative explanations when the data do not 
support the dominant theory. However, when she published her critique 
of sexual selection in Science in 2006,? over 40 prominent figures in 
evolutionary biology submitted 14 letters to the editors of Science that 
viciously criticized her claims and methods,?5 writing that her work rep- 
resents an “attack on Darwin”,2’ that she fails to understand the scien- 
tific method, and threatens to set evolutionary biology back by some 
30 years.% After this initial attack, Roughgarden’s views have been 
actively ignored and marginalized in the peer-reviewed literature, often 
being called “idiosyncratic”,*! “unusual”, “unorthodox”, represent- 
ing only a “fringe viewpoint”’* and “marred by bias”.3% Given her rea- 
sonable, welcoming and scientifically sound rhetoric, why have all of 
these evolutionary biologists responded to her work as if to a threat? 

One obvious answer is that Roughgarden’s 2004 book Evolution’s 
Rainbow makes an explicitly political intervention into evolutionary 
biology. She investigates the many species that differ from the male and 
female templates of sexual selection, the many species that engage in 
same-sex sexual behavior and the many species that raise young in social 
structures that have little in common with heteronormative monogamy 
or the nuclear family. In this earlier book, Roughgarden speaks openly 
about her own identity as a transgender woman and about the need for 
evolutionary biologists to pay attention to the wealth of primary data on 
animal diversity for both political and scientific reasons. Although The 
Genial Gene forwards a very different project that speaks specifically 
to Darwin’s theory of sexual selection and Roughgarden’s proposed 
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alternative, social selection, her colleagues’ distaste for her arguments 
is clearly colored by their reaction to Evolution’s Rainbow. This view 
is exemplified by the remarks of evolutionary biologist Troy Day who 
claimed that many people believe Roughgarden’s work to be “shoddy 
science and poor scholarship, all motivated by a personal agenda”.** 
Here we see a familiar story, where scientific objectivity is only acces- 
sible to some subject positions, and everyone else’s claims are considered 
to be “just politics”. “Personal agenda” is a barely disguised euphemism 
for Roughgarden’s openly LGBTQ+ politics, which she dared to include 
in a book about evolutionary biology. Her personal and political motiva- 
tions are wielded against her as the incontrovertible evidence for her lack 
of objectivity and her “shoddy science”, which can be explained away as 
an effect of politics. As Donna Haraway writes in her Primate Visions 
chapter on feminist paleoanthropologist Adrienne Zilhman: “woman 
the scientist becomes the trope figuring bias”.’® And here, for “trans 
woman the scientist” this is doubly so — as evidenced by the blatant 
transphobia in some biologists’ responses to Evolution’s Rainbow.’ 
According to these “critics”, scientific impropriety is her cardinal sin. 
First, she immodestly goes after Darwin’s master narrative of sexual 
selection from a marginalized subject position; Roughgarden explains 
that as an LGBTQ+ scientist, “it would [have been] okay to add a little 
fluff to sexual selection to account for gay and gender-bending animals, 
so long as I [did] not touch the central narrative”.* Secondly, by insist- 
ing on speaking politically in a scientific context, she is stubbornly “not 
in accordance with good manners, modesty, or decorum; unbecoming, 
unseemly; indecorous, indecent”.*! Put more simply: How dare you? 


Roughgarden’s Empirical Defense: Test More Hypotheses 


Despite Roughgarden’s explicit political stakes, she is careful to defend 
her work in strictly empirical terms, stressing the importance of test- 
ing hypotheses and finding the truth. In interviews, talks and popular 
articles, Roughgarden has responded to criticism, not by entrenching 
further into her own position but by inviting more evolutionary inquiry. 
This strategy can be seen, for example, in an online video interview with 
science journalist Robert Wright. Wright, who does not hide his skep- 
ticism of Roughgarden’s claims, presses her about her critiques of evo- 
lutionary psychology studies that are based in sexual selection theory. 
Wright cites a well-known study by Martin Daly and Margo Wilson, 
which claims that in humans, men are more jealous about the sexual 
infidelity of their partners, whereas women are more jealous of emo- 
tional infidelity.*? Their theory is based on a sexual conflict model that 
posits that males and females have opposing goals in reproduction and 
child rearing. The difference in the kind of jealousy experienced by men 
and women, they argue, is an evolutionary adaptation that helps males 
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ensure that they raise their own offspring and helps females ensure that 
the males will stick around to provide for their children. They write: 


Sociobiologists would expect male jealousy to be more specifically 
focused upon the sexual act than female jealousy. This is because 
the reproductive threat in a wife’s infidelity lies in the risk of alien 
insemination, whereas the reproductive threat in a husband’s infidel- 
ity lies more in the risk of lost resources.*4 


Wright is convinced that this theory makes excellent intuitive sense and 
is also borne out by the “raw data”. What interests me here is not only 
Wright’s certainty about the “raw data” from a decades old study, but 
Roughgarden’s response to Wright. She does not point out the gender 
stereotypes and heteronormative assumptions embedded in Daly and 
Wilson’s jealousy story. Instead she asks Wright “whether there was an 
alternative hypothesis that was on the table, which they could have con- 
firmed, instead of the one they claimed to have confirmed”. This strikes 
me as a tactful and potentially disarming response to Wright’s line of 
questioning. Roughgarden suggests that Daly and Wilson’s study, or at 
least the way Wright remembers it, might be “bad science”. Although 
she makes it clear that she is a proponent of evolutionary psychology 
as a field, she is concerned about the prevalence of studies where the 
“data are mined to effect an appearance of the confirmation of [a single] 
hypothesis”. In her response to Wright, Roughgarden demands a more 
rigorous relationship between narrative and evidence. She insists that 
evolutionary psychologists test more hypotheses. 

This raises the question of why scientific stories that make intuitive 
sense are perceived not only to be true, but supported by the empirical 
evidence. Historian of science Daryn Lehoux argues that it is common 
for us to credit empirical investigation when we are actually relying on 
commonsense beliefs.* His example comes from the ancient world. 
Greek and Roman authors like Plutarch, Ptolemy and Pliny the Elder 
believed — according to the laws of sympathy and antipathy - that if you 
rub garlic on a magnet, you can disable its attractive force. From today’s 
perspective this is obviously false, so why did these illustrious classi- 
cal thinkers believe it? Were the ancients simply dimwitted? Lehoux 
argues that, no, the ancients were not dimwitted and, in fact, our belief 
that garlic cannot disable a magnet is no more empirically sound than 
the ancients’ belief that it can. Have you ever rubbed garlic on a mag- 
net? Probably not. Lehoux suggests, “our argument against the garlic- 
magnet antipathy is no stronger, and, more importantly, no more or 
less empirical, than Plutarch’s argument for it”.*% Both of us are using 
categorical thinking to ground our beliefs: “Magnets used to be the 
kind of thing that was sympathetic, as was garlic. Now magnets are the 
kind of thing that are magnetic, and garlic in our experience is not”.* 
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In both cases, Lehoux argues, “classification was doing the epistemolog- 
ical work, but experience was getting the credit”.* When Roughgarden 
suggests that evolutionary biologists test more hypotheses, she encour- 
ages empirical investigation in a field where commonsense beliefs about 
the world are doing some of the heavy lifting. She has proposed a field 
called “sexual selection studies” specifically for the purpose of testing 
new hypotheses that diverge from the Neo-Darwinian orthodoxy.*? 

However, although Roughgarden’s proposal offers new empirical 
directions for evolutionary biologists, her call to test more hypothe- 
ses does not fully capture the role of personal experience and political 
commitments in Roughgarden’s work. Although her personal and polit- 
ical motivations are clear in Evolution’s Rainbow, she often dismisses 
their influence when discussing the importance of empirical inquiry. 
For example, writing about the dominance of sexual conflict narratives 
in evolutionary biology that make males and females into enemies and 
reproduction into warfare, Roughgarden writes: 


Yet again, the issue before us is not whether one finds these thinly 
disguised rape narratives appealing or repugnant. The issue is 
whether a kind of rape actually does underlie all male and female 
relationships throughout nature. Sexual-conflict advocates do not 
acknowledge even the possibility of alternative hypotheses springing 
from a different point of view. Nonetheless, the scientific method 
requires alternative hypotheses.5 


It is clear from her use of the description “thinly disguised rape narra- 
tives” that Roughgarden does indeed find these stories repugnant and 
this repugnance motivates her desire to search for evidence to furnish 
other narratives that can “populate our worlds and imaginations in a 
different way”.5! As she distances herself from her own emotions in this 
passage (“the issue is not whether we find these narratives appealing or 
repugnant”), I cannot help but wonder if it is possible to affirm these 
personal, political and empirical desires at the same time so that we 
can avoid “splitting our life, our bodies, our language, our breath into 
several worlds”.*? 


Reconciling Story and Evidence 


In this chapter, I move away from Roughgarden’s exclusively empirical 
defense of her work to argue that her political instincts are one of her 
essential epistemological strengths as an evolutionary biologist. If, as 
Isabelle Stengers argues, a materialism without eliminativism allows us 
to connect with the struggle over what matters and what is excluded from 
mattering, this is surely a materialism that allows us to imagine story- 
telling as a significant part of empirical inquiry. As a trans woman with 
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a commitment to LGBTQ+ politics, Roughgarden is acutely attuned to 
the hetero and cis normativity lurking within the sexual selection litera- 
ture that automatically pathologizes any departure from the universal 
male and female templates of sexual selection. Here she identifies the 
moralizing language used to describe different forms of sexual behavior 
and morphology: 


In the primary peer-reviewed literature, males are described as being 
“cuckolded”, females as “faithful” or “promiscuous”, offspring as 
“legitimate” or “illegitimate”, males who do not hold territory as 
“floaters” or “sneakers” (code for “sneaky fuckers”) all of whom 
are “sexual parasites”, small males as “gigolos”, feminine males as 
“female mimics” or even as “transvestite serpents” or “she-males” 
(a pornographic reference) and so forth.” 


Examples of this kind of moralizing language in evolutionary biology 
and science media are not hard to find. For example, there is a short seg- 
ment from the popular BBC documentary series Life (2009) that illus- 
trates the ubiquitous pathologization of feminine males. This segment 
features the giant cuttlefish — a species with two distinct phenotypes of 
males: A large-territory holding male and a small feminine male. We see 
a female with a large male cuttlefish, being approached by a small male. 
David Attenborough’s familiar and sonorous voice reads: 


Cuttlefish are good communicators, but there is a flip side; they can 
also be masters of deception. This male is too small to fight for a 
mate. But he has another plan and it’s sneaky. He approaches the 
couple cautiously, holding his tentacles tucked up at the front, mim- 
icking a female that wants to mate. To complete his disguise, he 
changes color to appear even more like a female. The guarding male 
seems convinced. Maybe he thinks his luck is in; another female to 
add to his conquests. The sly crossdressing male edges closer and 
closer to the female, holding his nerve. As long as he avoids being 
grabbed in a mating embrace, the sneak is safe. At what point the 
female guesses his true identity is unclear, but she isn’t choosey and 
surreptitiously mates with him right under the larger male’s tenta- 
cles. It’s time for the female to lay her eggs. Using the sperm from 
both males, she fertilizes her eggs one by one...with luck, some 
may become masterful males and others, little sneaks — shell have 
all the bases covered. 

(emphasis mine) 


The italicized language used to speak about the small male cuttlefish 
relies on an unspoken and arbitrary parallel between this male pheno- 
type of cuttlefish and human trans women. This narrative, furthermore, 
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employs a particularly ugly stereotype, namely that trans women are 
illegitimate women, who mimic “real” women in order to fool hetero- 
sexual men and sneak into women-only spaces — an ideology increas- 
ingly contested, but nonetheless omnipresent in American culture from 
The Crying Game, to the Michigan Womyn’s Music Festival, to the 
recent proliferation of so-called Bathroom Bills.5* When this rhetoric 
is isolated and subjected to even the most rudimentary critical thought, 
it becomes clear that evolutionary biologists have grafted a repugnant 
human stereotype onto the natural world and left it there, hidden in 
plain sight. How could this narrative be anything but woefully inade- 
quate to describe the behavior of these socially complex cephalopods? 
As Emily Martin argues in her classic article “The Egg and the Sperm”, 
it is not only politically important to identify harmful stereotypes in 
scientific literature, but that this activity also benefits empirical inquiry: 
“Waking up such metaphors, by becoming aware of when we are pro- 
jecting cultural imagery onto what we study, will improve our ability to 
investigate and understand nature”.*° 

Having identified the transphobia lurking in the literature on species 
with multiple male phenotypes, Roughgarden is able to subject the claim 
to empirical scrutiny. Is the large male actually duped by the smaller 
male? Roughgarden does not think so: “The territory-holding male is 
often a visual predator with well-honed skills at sizing up and identi- 
fying prey from a distance; he is not likely to be fooled by a feminine 
male who only imperfectly resembles a female”.5 Here Roughgarden’s 
personal and political distaste for language that polices gender, sexual- 
ity and kinship is the motivation for narrative speculation and further 
empirical inquiry: Does the evidence support this narrative? Is there 
another story? Can the evidence support another story? Is there a way 
to affirm, rather than deny the importance of narrative - narrative affin- 
ity, narrative repulsion — in Roughgarden’s work without also losing 
the scientific rigor or the strength of her knowledge claims? To embrace 
storytelling as scientific practice without fear of relativism or perma- 
nently de-stabilizing evidence in evolutionary biology? To grapple with 
the political questions of biological storytelling rather than pretending 
that science is free of politics? These are the questions that remain for 
me at the end of The Genial Gene. I am left wanting a different way of 
imagining the relation between story and evidence, where narrative is 
not ultimately subordinate to data. 


How Many Plots Can the Data Hold? 


The question that incites me is not Roughgarden’s question: “Is this 
story true?”, but something more speculative, a question that opens up 
rather than forecloses narrative possibilities in evolutionary biology. 
Working from Roughgarden’s commitment to testing more hypotheses, 
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the question I want to ask instead is: “How many plots can the data 
hold?”57 Here I use Sabina Leonelli’s definition of “data” as “any prod- 
uct of research activities...which is collected, stored and disseminated in 
order to be used as evidence for knowledge claims”.5 With this question, 
with this refrain,” I’m playing with the multiple meanings of the word 
“plot”. Plotting a graph is the practice of drawing relations between 
data points. Data points are not meaningful on their own, but must 
be brought into relation with one another to become evidence. There 
are different ways of connecting the dots, as it were; some better than 
others. What is included, what is excluded, what becomes signal, what 
is noise is decided through a process of interpretation. As Leonelli sug- 
gests, “the same set of data can act as evidence for a variety of phe- 
nomena, depending on how they are interpreted - a feature...central to 
understanding the epistemic power of data as research components”.50 

“How many plots can the data hold?” uses graphing as a visual meta- 
phor for thinking about the relationship between narrative and evidence. 
Plotting is, of course, also the practice of storytelling. Of identifying 
meaningful actors and actions, of ordering them in time, of discerning 
cause and effect. “How many plots can the data hold?” can open up new 
pathways of narration, relation and investigation. To plot a graph and to 
plot a story are both meaning-making activities. “How many plots can 
the data hold?” asks us to multiply our meaning-making strategies. To 
try on different stories, categories and metaphors to make sense of our 
world. The answer to this question might be more than one.°' But it is 
also not a relativist question; the answer is not infinite. 

This refrain is my attempt to pose a question at the intersection of 
story and evidence. A question that is simultaneously speculative and 
pragmatic. A question that feels actionable. I developed this formulation 
to find another way to approach scientific work like The Genial Gene, 
where we would not have to separate the empirical/scientific from the 
narrative/political. What is exciting to me in The Genial Gene is that it 
takes us inside the most familiar biological stories and insists another 
story is possible. The peacock’s tail might not be the ultimate example 
of a world in which males compete for access to females, who choose 
their mates based on bright colors or good genes. When Takahashi et al. 
found that their data would not hold the sexual selection narrative, they 
looked for evidence that would furnish a different story. They investi- 
gated the role of estrogen in plumage color; Roughgarden investigated 
the social structure in which peafowl rear their offspring. Going back 
into the peer-reviewed literature, into studies that have already been 
completed, and asking “How many plots can the data hold?” offers dif- 
ferent empirical and narrative possibilities for the practice of doing evo- 
lutionary biology. 

Asking “How many plots can the data hold?” invites the kind of empir- 
ical, narrative, speculative and political inquiry, where evolutionary 
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biology could be called upon to contest rather than confirm an established 
order. Not by dropping science and picking up politics, but by working 
with story and data simultaneously, with equal skill and seriousness. 
This is what Isabelle Stengers means by a materialism without elimina- 
tivism. To approach this question with skill and seriousness, I believe, 
we cannot rely on familiar knowledge-making practices. We would need 
to devise new connections between the sciences and the arts and human- 
ities, new ways of working together and new kinds of accuracy. 

Accuracy is a term that we tend to associate with the methods of nat- 
ural sciences, with statistical practices such as excluding outliers from 
datasets and calculating margins of error. However, in the arts and 
humanities, we also experience our activities as a process of working 
with and toward accuracy. Take, for example, this excerpt from an inter- 
view with Canadian poet Anne Carson on the topic of writing: 


we're talking about the struggle to drag a thought over from the 
mush of the unconscious into some kind of grammar, syntax, 
human sense; every attempt means starting over with language. 
starting over with accuracy. i mean, every thought starts over, so 
every expression of a thought has to do the same. every accuracy 
has to be invented. 


Carson’s accuracy is not a scientific accuracy that is about bringing a 
measurement as close as possible to the correct value, but a linguistic 
accuracy. It pertains to the difficulty of capturing, or maybe rendering, 
something with language. The poetic injunction to avoid hackneyed sig- 
nifiers and to begin again every time with language as if from scratch. 

This is why the empirical and narrative question “How many plots 
can the data hold?” is fundamentally an interdisciplinary question. It 
requires people trained in different kinds of disciplinary accuracy, con- 
summate storytellers and consummate observers, experimenters, stat- 
isticians, working together on a practice where neither the data nor the 
story is foundational, but where they must be handled together. “How 
many plots can the data hold?” is an invitation not just to mix pre- 
existing disciplinary practices, but to invent new forms of accuracy that 
might be unfamiliar or awkward but could be epistemologically, narra- 
tively and politically generative. 

This proposal requires a fundamentally different kind of interdisci- 
plinary, one that is open-ended and nonhierarchical. As I have argued 
elsewhere,® the pressure on scientists to publish disincentivizes lengthy 
and uncertain collaboration. Making space for scientists and humani- 
ties scholars to learn from one another, to pursue mutual curiosity and 
devise new ways of working together is necessary for true interdiscipli- 
narity, as is allowing time for frustrations, dead-ends and failures. With 
its focus on productivity and quantifiable outcomes, the contemporary 
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neoliberal university is ill-equipped to support these kinds of uncertain 
and exploratory collaborations. However, if we want to resist the status 
quo and forge new relations between stories and evidence, we must value 
the slow work of coming together around problems that we thought had 
already been settled and ask questions like, “How many plots can the 
data hold?” 

Of course this is not the only way to imagine the relation between 
story and evidence. Data does not neatly precede story; data is always 
already theory-laden.5* Stories guide how we pay attention to the world 
and what seems significant in the first place. And sometimes the work 
to craft just one good story or even a partial story from the chaos of the 
data is the real epistemological and political challenge. I offer “How 
many plots can the data hold?” as a seed, a meme, a spark. A call for 
fewer “Just So” stories and more “What if?” stories.6° To use the spec- 
ulative to crack open the ordinary. To embrace rather than disavow the 
storytelling practices of scientists like Joan Roughgarden. To fashion a 
possible attachment site for cross-disciplinary collaboration. To invent 
new forms of accuracy. To practice a materialism without eliminativism. 


Epilogue: The Oulipo Cuttlefish 


I conclude my chapter, not with a further critique of the dominant 
accounts of sexual selection, but with an alternative feminist narrative 
about the cuttlefish from BBC Life. To write this story, I used the Oulipo 
technique of constraint-based writing. The Oulipo are a group of mostly 
French poets and mathematicians, who write using self-imposed con- 
straints or protocols, the most famous of which is Georges Perec’s novel 
La Disparition (1969), written without the use of the letter “e”, the 
most common letter in the French language. However, the purpose of 
Oulipo writing is not only creating works that demonstrate linguistic 
playfulness or formalist mastery but, as their name suggests,* devising 
procedures for thinking otherwise: 


For the Oulipo, constrained writing does not necessarily aspire to 
the creation of a literary work; rather, it participates in a general 
research program invested in interdisciplinary invention, collabo- 
rative innovation, ludic approaches to writing and reading, and the 
elaboration of new economies of expression, complex literary forms 
that become the springboard for a speculative lit[erature].°” 


For this task, I decided to describe what I was seeing on the screen, while 
using only the vowels A and I (no E, O, or U). I chose this lipogram exer- 
cise for generating my counter-narrative, because of the way constraints 
help us to avoid the most naturalized and clichéd language. As I was 
composing my script, I was most struck by how the frustration of not 
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being allowed to use a desired word quickly gave way to new opportuni- 
ties, how unanticipated possibilities emerged when I found my narrative 
pathway blocked. Occasionally an appropriate synonym was available — 
but even then, my intended meaning was already shifting, leading in 
different directions than I had initially planned; I found “many subtle 
channels”®® opening up before me. 

In this short narrative, which begins with the small male approaching 
the female and the large male, I tried to imagine cuttlefish mating with- 
out recourse to pathological language or the concept of deception: 


Radiant fish, with his skin alight, all arms and charisma. Swimming 
in amid this captivating pair, his arms in tight, shifting his skin, 
flashing dark and bright. His timing is right. This striking fish with 
rippling fins, inviting his mating arm in, is brilliant and satisfying 
against his skin. As is this vigilant watchman draping his arms, 
incasing this activity with his vast calm. It is as if it was always like 
this. S. apama bliss. 


In this narrative, the cuttlefish, who were previously possessive and 
sneaky, become serene and alluring; each individual participates actively 
and knowingly in the intimacy of the scene. Without the words “male” 
or “female”, without the full complement of English pronouns, it 
becomes necessary to find other ways to name the animals and describe 
their behaviors. In the absence of pronouns, a multitude of adjectives 
rush in, beckoning the listener into the encounter: Radiant, striking, 
rippling, brilliant, satisfying, vigilant and vast. Unlike Attenborough’s 
narration, this story asks us to consider the subjectivity of animals 
without recourse to a mechanistic nature that is red in tooth and 
claw. While it may feel anthropomorphic to ascribe particular moods 
and thoughts to the cuttlefish, is it any more anthropomorphic than 
Attenborough’s story? Why does a deceptive cuttlefish seem more sober 
and realistic than a blissed-out cuttlefish? Why is it so risky for evo- 
lutionary biology to “admit pleasure, play, or improvisation within or 
among species” ?° 

How can a story like this sensitize us differently to the lives of ani- 
mals? What do we notice that we did not see before? What captures our 
curiosity when we do not feel we already know the story before it has 
been told? This is, of course, not the only alternative to the transphobic 
sexual selection narrative. What story would you tell me about the cut- 
tlefish if Igave you an E and an O? 

Oulipo writing is just one possibility for exploring resistances and 
potentials of language, as we seek to tell better stories about the natural 
world. In answering the question “How many plots can the data hold?”, 
we can experiment with form, not in pursuit of the avant-garde, but 
as a way of activating different bio-poetic and therefore bio-political 
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possibilities. Although these stories might ultimately not account for 
complex natural phenomena, such as a species with multiple sex pheno- 
types, these poetic hypotheses can reorient our attention and reroute our 
curiosities. In this way, evolutionary stories can act as fables of atten- 
tion, helping us ask animals better questions,”° which in turn can gener- 
ate new evolutionary hypotheses. When it is obvious that the dominant 
story is not enough, as is the case with the cuttlefish, we need to open 
up the relationship between story and evidence, to generate new ques- 
tions and see where these questions can take us. A materialism without 
eliminativism affirms this kind of “interpretive adventure”,’! over and 
against forces that would settle scientific facts once and for all. In this 
way, Stengers encourages us to disavow scientism and affirm a science 
capable of connecting with the diverse and ongoing struggles for more 
livable technoscientific worlds. 
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4 Rethinking Evidence Practices 
for Environmental Decision- 
Making in the Anthropocene 


What Can We Learn from Invasive 
Species Research and Policy? 


Christoph Kueffer 


We live in a time of multiple, interacting and accelerating crises, includ- 
ing climate change, overexploitation of natural resources, pollution, 
growing inequalities and injustice, political and social instabilities, war, 
migration and weakened democratic and truthful deliberations.! Many 
of these crises are directly or indirectly linked to the degradation of eco- 
systems and biodiversity loss.” Since 1993, the nations of the world have 
committed themselves to the protection and restoration of the Earth’s 
diversity of life through the UN’s Convention on Biological Diversity 
(CBD).? The UN Decade on Ecosystem Restoration from 2021 to 2030 
further emphasizes the urgent need to reverse the degradation of ecosys- 
tems worldwide within the coming years.* 

Evidently, the current economic system is a major driver of ecological 
degradation, and technological solutions will not suffice to avert cata- 
strophic climate change and biodiversity loss.° The UN’s “17 Sustainable 
Development Goals” of the 2030 Agenda for Sustainable Development 
instead recognize the need for integrative sociocultural and ecological 
solutions.’ This will require that the voices and ecological competencies 
of diverse cultural groups, many of them marginalized or oppressed, must 
be strengthened with the help of expertise from the humanities, social 
sciences and arts.* Following an era dominated by economics and engi- 
neering, the 21° century must become a century of cultural diversity and 
ecological sensibilities. Indeed, ecology is reaching the status of a guiding 
natural science of our time. Since 2012, the Intergovernmental Science- 
Policy Platform on Biodiversity and Ecosystem Services (IPBES) has been 
coordinating experts around the world to assess ecological knowledge for 
policy-making.” While for most of the 20" century physics was seen as 
the paradigmatic model of scientific inquiry, in the 21° century, we must 
better appreciate the ontological, epistemological, methodological and 
pragmatic implications of an ecological view of nature and human-nature 
relationships.! Rich and thorough ecological expertise is essential for an 
urgently needed societal transformation toward a sustainable future.!! 
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Such an ecological turn will have important implications for how 
we see the role of scientific evidence in resolving conflicts and legiti- 
mizing decisions. Ecological expertise is confronted with particularly 
difficult challenges. Expertise about the open and non-equilibrium envi- 
ronmental systems of the Anthropocene is inevitably highly uncertain. 
Open environmental systems are characterized by features such as non- 
linearity, emergent properties, non-equilibrium and causal chains that 
span vast spatial scales that make robust prediction and reliable advice 
on effective system manipulation difficult. This makes it also hard for 
experts to demonstrate that their evidence is reliable.!? Moreover, the 
experimental testing of hypotheses and refinement of solutions through 
learning-by-doing in a controlled setting such as a laboratory is often 
not possible.!? 

To circumvent these problems, the modern natural sciences have often 
used the strategy of turning open-system problems into closed-system 
problems. Accordingly, innovations have been developed in laborato- 
ries and their risks assessed based on highly simplified model systems, 
while the potential consequences on the environment have often been 
neglected.!* Intensive agriculture and plantations, for instance, have been 
designed so that they can easily be controlled and manipulated, while cit- 
ies and technical artifacts are considered separate from nature. This has 
often led to unintended consequences stemming from new technologies 
and other innovations on the natural world. It has hitherto been possible 
to neglect these negative externalities because the planet that provided 
us with free ecosystem services and goods quietly absorbed our pollut- 
ants and waste and allowed us to conduct our dangerous experiments 
and destructive activities in remote areas where those affected, whether 
human or non-human, were powerless.!5 

Meanwhile, and especially since World War II, we have lost most of 
the refugia of nature,'° and we now live in a full world,” with no cheap 
nature left.!5 A key characteristic of the Anthropocene is that even the 
rich and powerful among us can no longer escape the causal intercon- 
nections between the environment and human systems. Whether in a 
laboratory, in relation to technical infrastructures, in cities, in intensive 
agriculture or in the way we imagine our social and culture life, nature is 
talking back. We have to relearn how to listen to nature, while accepting 
that our knowledge about nature is inevitably incomplete and ignorance 
widespread. 

A second challenge is that our thinking about nature and human- 
nature relationships is undergoing a paradigm shift. Fundamental 
ontological, epistemological, methodological and ethical assumptions 
underlying ecological research and our understandings of nature and 
human-nature relationships are open for debate in our pluralistic and 
globalized society. When such a phase of cognitive indeterminacy occurs 
in a field of expertise so closely intertwined with deliberations in society, 
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the situation further complexifies. Silvio O. Funtowicz and Jerome R. 
Ravetz!? have called this type of science-policy nexus post-normal in 
reference to Thomas Kuhn’s description of scientific revolutions.*° 
Fundamental assumptions about what counts as relevant and relia- 
ble expertise and evidence as well as about the ontology of the study 
subjects and the ethics and goals of interventions are being questioned 
from multiple and conflicting perspectives from within the sciences and 
society at large.?! Because these various assumptions are mutually inter- 
twined, it is difficult to separate political, cultural, ethical, epistemolog- 
ical and ontological aspects of a controversy.” And because conflicting 
perspectives are often incommensurable, there is no arbiter available to 
clarify debates. 

This situation is further aggravated by the fact that our knowledge 
about nature is rarely based on direct observation accessible to a non- 
expert anymore; rather, nature increasingly speaks to us only indirectly 
through various specialized scientists and their diverse tools. Thus, sci- 
entific evidence about nature is increasingly more open to alternative 
and often conflicting interpretations.” When nature still speaks directly 
to us, many of us have lost the competencies to listen — we depend on 
interpreters to explain the ecological realities around us. 

There is no easy way out of this bind. In particular, there is a growing 
recognition that reducing ambiguities by turning pluralistic and open- 
system problems into disciplinary and closed-system problems only 
worsens the situation.** Instead, we need to develop a new culture of 
evidence practices that embraces pluralism, ambiguity and ignorance. 
In some cases, previous strategies of evidence-based decision-making, 
such as the use of projections, risk assessments or cost-benefit anal- 
yses, still work.25 In other cases, it might be more effective to design 
evidence-based decision-making processes and policy institutions that 
are more inclusive and transparent and facilitate continuous social learn- 
ing.”° In ecology, for instance, there is a long tradition of adaptive man- 
agement processes that attempt to continuously improve interventions 
in nature through social learning-by-doing in the real-world settings of 
particular environmental problems.’ 

Often, however, it is not even clear what constitutes a scientific and 
societal problem, how it should be approached and who the relevant 
experts are. In such a situation, the formulation of the framing of the 
societal and scientific problem becomes in itself a critical step in the pro- 
duction of reliable and socially robust evidence.?® Transdisciplinary and 
participatory research aims at clarifying contested problem structurings 
in pluralistic decision-making contexts.*? Arguably, the situation is even 
more ambiguous in the case of ecological expertise in the Anthropocene 
because the epistemology and ontology of a whole research field - 
ecology — and even whole epistemes are exposed to heightened dis- 
agreement. It might therefore be necessary to embrace pluralism and 
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disagreement as an opportunity for renegotiating the very fundament of 
our thinking.*° The role of experts might become one of nurturing crit- 
ical thinking, virtues and cultures of responsibility and empowerment 
and agency rather than of attempting to achieve a definite clarification 
of problem diagnosis, targets and solutions.*! 

In what follows, I present the example of invasive species research 
and policy as a model case of a scientific and societal issue that is char- 
acteristic of evidence-based deliberations in ecology and environmental 
decision-making in the 20" century. Biological invasions are the result 
of global environmental changes and globalization and are considered 
one of the main drivers of the biodiversity crisis. While there is a well- 
established expert community that addresses the issue through research 
rooted in a mainstream scientific discipline — ecology - the interpretation 
of the scientific evidence and the conclusions drawn for management 
action are increasingly contested from numerous angles; thus, biological 
invasions represent a case of post-normal science. ** 

Biological invasions were formally recognized as a specific scientific 
and societal issue after World War II. The framing of the problem is 
thus rooted in post-war ecological science and environmental decision- 
making. It was an era when ecological problems were framed as socially 
and epistemologically well-bounded issues amenable to clarification by 
academic and disciplinary ecologists alone and solved through policy- 
making that closely follows scientific assessments such as cost-benefit 
analyses or scenario analysis (mode 1 knowledge production sensu 
Helga Nowotny and colleagues).* 


Ecology and the Science-Policy Nexus after World War II 


The core of academic ecology after World War II contrasted strongly 
with early modern ecology in the 19 and early 20 centuries; thus, 
the expert culture of the post-war years was socially constructed in a 
specific way, and this shaped ecological thinking and decision-making 
related to the different environmental crises of the 20" century, includ- 
ing biodiversity loss and climate change. 

Applied ecology was often institutionally isolated from basic ecol- 
ogy. It was widely distributed across diverse research institutions and 
departments of applied sciences such as natural resources manage- 
ment, fisheries, forestry or agriculture,** and scientists with an ecolog- 
ical expertise and research focus also worked at departments ranging 
from geography and anthropology to the environmental sciences. In 
contrast, basic ecology was increasingly separated from applied ecol- 
ogy and non-biological sciences, including geography and the social 
sciences, which in the 19!" and early 20" centuries shared interests and 
regularly collaborated with ecology. A reflection of this separation was 
that humans were excluded from basic ecological theory as an agent 
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integral to ecological systems. An interest in the ecology of human- 
made ecosystems such as cities, for instance, only re-emerged much 
later. A gap opened between ecology and the social sciences and 
humanities. Partly this was a consequence of the episteme of modernity 
that assumed that nature and culture were separate realities, but it was 
also a result of more specific misunderstandings between natural and 
social scientists among others resulting from the heated sociobiology 
debates of the 1970s.>° 

Reductionist ontological frameworks increasingly shaped ecological 
theories.*7 The study of animal behavior came under the influence of 
behaviorism. Animals were interpreted as beings without consciousness 
and their behavior as purely mechanistic - following René Descartes’ 
characterization of animals as machines. Animal behavior was studied 
in animals in captivity and often by harming them. The emergent prop- 
erties of species communities were interpreted as the result of the inter- 
play of autonomous individuals that compete for limited resources?’ — an 
ontological understanding of species coexistence that is interpreted by 
some historians of science as being rooted in an ideology of liberalism.% 
Ecosystem ecology that explained the overall workings of ecosystems 
as characterized by fluxes of energy, matter and information in anal- 
ogy to physics solidified through major funding from the US Atomic 
Energy Commission with the goal of understanding the fate of radioac- 
tive isotopes in the environment.* It was further developed by building 
on the toolbox of systems science and cybernetics and with the help of 
computer simulation modeling.*! Such systems ecology can be seen as 
technocratic,* and as an approach that characterizes ecosystems as a 
kind of a machine.* 

After World War II, the ambition of basic ecologists was to advise 
on global-scale policies on biodiversity with context-independent and 
globally applicable knowledge intended to represent the consensus of 
a global scientific expert community, comparable to the advisory work 
of climate modelers in climate policy. However, it was not possible to 
make quantitative predictions as a basis for policy-making using com- 
puter simulations like those of climate scientists.** Instead, the hope was 
to deduce policy advice directly from ecological theory. For instance, 
mathematical models from population biology were used to determine 
minimal viable populations of threatened species;*> species coexistence 
theory was used to show why local species diversity matters for ecosys- 
tem functioning;** biogeographic research on the correlation between 
the size of oceanic islands and the number of species present on these 
islands to advise on the design of nature protection areas;* and a com- 
bination of theoretical assumptions from biogeography, population ecol- 
ogy and evolutionary biology to argue that nonnative species — i.e. those 
introduced to a new geographic area by humans - pose high ecological 
risks (see below). 
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Deduction of expert advice and implicitly normative judgments 
from general scientific laws and thus underlying ontological and epis- 
temological assumptions can be problematic, especially when implicit 
assumptions and how they shape sociopolitical discourses are not made 
transparent.* In particular, the assumption that non-anthropogenic, 
pristine ecological systems are characterized by a particularly high degree 
of biological organization implicitly influenced research and policy. In 
research, interpretations and generalizations of observational data were 
built on the assumption that ecological patterns represent well-designed 
adaptations. According to such a view, species traits represent optimized 
designs that help species to survive under particular environmental con- 
ditions, interactions of species are fine-tuned through coevolution, and 
the composition of species community is the result of ecological sort- 
ing so that coexisting species with complementary specializations (i.e. 
niches) fit together like pieces of a puzzle. This adaptionist interpretation 
has been criticized as empirically unjustified teleological thinking” and 
as based on an empirically unjustified assumption that there is some 
kind of harmonic balance in nature.” In policy, the view that pristine 
nature is particularly well-functioning thanks to long-term coevolution 
and ecological sorting led to the presumption that humans are by default 
a problematic disturbance factor in nature; and thus that protected nat- 
ural areas are ecologically preferable to managed land and that species 
introduced by humans to an ecosystem — alien species — pose ecolog- 
ical risks. In the Anthropocene, these assumptions confront ecology 
with epistemological and pragmatic problems given non-equilibrium 
and anthropogenic ecological realities.5! A second important implicit 
assumption was that ecological issues were framed as global rather than 
local policy issues. Ecology tried to fit into the emerging framework 
of climate change and global change science and policy.*? The concept 
of biodiversity was meant to condense the overwhelming diversity of 
life across the multitudes of local places on Earth into one concise and 
highly generalized entity that could be used to talk to international deci- 
sion makers. According to E.O. Wilson, the term was meant to become 
“the talisman of conservation, embracing every living creature”.°? This 
framing of ecological thinking and decision-making contributed to une- 
qual und hegemonic globalized discourses about nature.*4 

In this context, biological invasions were conceived as a scientific prob- 
lem and a societal issue. This background is important in understanding 
how invasion biologists were at first successful in framing a complex 
socioecological problem in such a way that a small and homogeneous 
group of scientists was accepted as the only legitimate experts and their 
expertise was largely undisputed, and how thereafter it developed into 
a highly contested post-normal issue characterized by incommensurable 
disagreements among experts and widespread contestation of evidence 
and policies by diverse stakeholders.* 


Evidence Practices for Environmental Decision-Making 107 
Case Example: Invasive Species Research and Policy 


As long as humans have migrated across the planet, they have carried 
other species to new places.°° For instance, the successful expansion 
of indigenous people across the Pacific and the colonization of remote 
islands thousands of years ago depended on plants that they transported 
with them,” in Greek and Roman times, alien species were part of 
religious ceremonies,’ and the redistribution of diseases, animals and 
plants played an important role in colonial expansion.’ The transporta- 
tion of species to new places was often deliberate because of their known 
usefulness, and thus they played an important subsistence role and were 
often perceived positively and integrated into daily life.°° Alien species 
had manifold cultural and symbolic meanings, including as part of reli- 
gious practices and as ornamentals.°' These meanings often differed for 
different social groups.“ Thus, throughout human history, alien species 
have been an integral part of livelihoods, and the perceptions of them 
have been pluralistic. 


The Initial Framing of Invasive Species Research and Policy 


When naturalists in the 18 century started to systematically doc- 
ument the diversity of the natural world, human-associated species 
were recognized as such but not seen as something fundamentally 
different from naturally occurring species.6° Early 20'-century plant 
ecology further developed a differentiated conceptualization of dif- 
ferent types of human-associated plant species, and they studied how 
humans shape local floras among others in urban areas.°* Thus, these 
early naturalists addressed human-associated species as part of their 
broad interdisciplinary interests in the interplay of geographic, eco- 
logical and human factors in shaping the landscapes and biomes of the 
planet. It was only in the 1950s that introduced species began to be 
portrayed as a distinct scientific and societal problem. A book entitled 
Ecology of Invasions by Animals and Plants published in 1958 by 
the leading animal population ecologist at the time, Charles Elton, is 
generally seen as the birth of formalized research on invasive species.°° 
The book initially triggered little interest in invasions as an environ- 
mental problem but was rather read as a contribution to basic ecol- 
ogy.56 It was an international research program within the Scientific 
Committee of Problems of the Environment (SCOPE) framework“? 
focused on biological invasions that triggered the rapid growth of a 
new research field specifically focused on biological invasions in the 
1980s.5% Elton’s 1950s book and the subsequent international SCOPE 
research program in the 1980s are here treated together as the phase 
leading to the initial problem framing of formalized invasive species 
science and policy. 
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This initial framing of biological invasions as a scientific and soci- 
etal problem has some interesting characteristics.© A diverse array of 
complex socioecological phenomena was subsumed under one unifying 
framework rooted in ecological theory. According to the broad scope of 
the postulated problem structuring, biological invasions encompass all 
alien organisms, ranging from animal and plant diseases to plants and 
mammals in all biomes of the world - from the Arctic to the tropics, 
both terrestrial and marine - that spread in all sorts of wild and man- 
made landscapes and are associated with diverse human activities. One 
achievement of Elton and subsequent invasion science was that insights 
from biogeography, population, community, ecosystem, landscape and 
evolutionary ecology were integrated to look at very diverse ecolog- 
ical phenomena through a single unifying lens, thereby contributing 
to theoretical synthesis in ecology. In contrast, there was little recip- 
rocal conversation with applied research fields such as weed science, 
plant health, biological control or epidemiology that already had a long 
tradition of working on some of the issues that were now considered 
biological invasions. The new scientific framing thus redefined different 
applied ecological research questions as examples of the same kind of 
phenomenon, the essential workings of which should be clarified by 
basic ecology. 

The underlying assumption that allowed for such a broad-brushed 
generalization of diverse real-world phenomena was that all natural 
ecosystems were considered to be uniformly characterized by the same 
ordering principles, and the modulating effects of the particular socio- 
ecological contexts were considered to be negligible in comparison to 
these universal ecological principles. In particular, humans were seen as 
an external disturbance to natural systems. Because alien species are by 
definition a human-induced change of the pre-human species composi- 
tion of ecosystems, they were therefore by default considered a risk to 
the well-functioning of ecosystems. The (perceived) unusual population 
dynamics of invasive alien species, i.e. their rapid spread and tendency 
to reach high abundance, was attributed to their human-associated ori- 
gin. Their nonnative origin was thus seen as the keystone of the causal 
interpretation of the dynamics of biological invasions — a view derived 
from particular ontological and epistemological assumptions about how 
nature works and should be studied. At the science-policy interface, 
these presumptions legitimated the normative claim that alien species 
are by default problematic and therefore should be prevented from enter- 
ing new areas and where present should be controlled and if possible 
eradicated. 

This normative prejudice gained special weight in decision-making 
because it was argued that, in line with the precautionary principle, the 
risk of biological invasions should be prevented proactively, i.e. newly 
arriving alien species should be controlled and if possible eradicated 
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before an invasion could happen and therefore before any empirical 
data that demonstrated their negative impacts in a particular location 
became available. A normative principle of environmental policy — the 
precautionary principle — thus legitimized policy advice from ontologi- 
cal presumptions about nature without the need to refer to case-specific 
empirical data. The question of how to legitimize precautionary action 
has since been constantly renegotiated in invasive species research and 
management. 

At first, however, invasion biologists were not forced to engage in 
deliberations about their implicit assumptions and were very success- 
ful in getting their perception of a new environmental risk integrated 
into policies at national and international levels. National and inter- 
national legislation, science and policy networks and institutions and 
tools such as data inventories were quickly and widely established.” 
In 1993, the UN’s Convention on Biological Diversity (CBD) came 
into force and included article 8(h) on invasive alien species, requiring 
parties to “prevent the introduction of, control or eradicate those alien 
species which threaten ecosystems, habitats or species”, and the World 
Conservation Union (IUCN) established an invasive species specialist 
group.’! 

A number of hypotheses can be formulated to explain why the need 
to proactively address the problem of biological invasions according to 
a framing proposed by a rather small group of invasion biologists was 
initially not contested and explains why these scientists were effective 
in influencing policies. First, the recognition of a new ecological risk 
resonated well with the emerging environmental awareness and the 
growing interest in problems attributable to global change. Invasions 
were seen as a paradigmatic example of the ecological consequences 
of environmental degradation and globalization. The SCOPE research 
program, which was a key driver for the formation of institutionalized 
invasive species research, was along with, for instance, the International 
Biological Program (IBP), aimed at addressing global environmental 
problems through coordinated international efforts. It further helped 
that invasions proved to be an interesting global natural experiment that 
could be studied particularly well through internationally coordinated 
multisite research, which increased its attractiveness for basic ecologists. 
Essentially, during colonial expansion, the same set of species was intro- 
duced to North America, South Africa, Australia, islands in the Pacific 
etc., and after 50-200 years, their fate in different biogeographic regions 
and habitats could be compared and analyzed based on observational 
data in, as it were, a long-term, outdoors multisite experiment (i.e. a 
natural experiment).’? 

Second, in contrast to other applied ecological research, invasion biol- 
ogy had close institutional affinities to basic ecology and could profit 
from the social status of leading ecologists. Charles Elton, for instance, 
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was the leading animal population ecologist of his time and his book 
built on three lectures he gave on BBC radio to a large audience.” 
Equally, the SCOPE program involved some of the leading ecologists of 
the 1980s, and invasions were seen as a model system to test and further 
develop ecological theory, thereby raising the status of invasion-related 
research within basic ecology.” Third, with the emergence of interna- 
tional biodiversity policy institutions and legal frameworks such as the 
Convention on Biological Diversity in the 1990s, the scientific results 
of the SCOPE program about biological invasions came at the right 
moment to be integrated into international and then national legisla- 
tion, and invasion biologists were well networked with decision makers 
in international biodiversity policy. Fourth, the proposed management 
actions fitted with established institutional frameworks and interests 
of stakeholders. Legislation and institutional mechanisms from plant 
health and animal and human epidemiology for the precautionary regu- 
lation of the transportation of problem species between nations already 
existed. Authorities at borders were prepared to control transboundary 
movement of listed species, and invasion biologists, for their part, were 
in a position to develop risk assessment tools that identified problem 
species as a basis for preventative screening. Also, the control and if 
possible eradication of problematic species — pests and weeds — was a 
well-established strategy that nourished a large and profitable industry 
and profited from broad social acceptance. And, lastly, the inherent nar- 
rative of invasion biology brought together cultural stereotypes from 
across the political spectrum: To prevent the unregulated “invasion” by 
“nonnative” species from outside a nation, to weed out and kill problem 
species and to protect pristine nature from negative human influence. 

Thus, in summary, the case of invasive species research and policy 
rooted in the 1950s and developed throughout the 1980s and 1990s 
turned a broad range of complex socioecological phenomena into a 
socially and epistemologically well-bounded one, thereby containing 
contestation of evidence and its interpretation within the sciences as well 
as in society. A small and homogeneous group of scientists — trained in 
ecology and working at natural sciences departments — was privileged 
as the relevant experts. They advised on policy by using generalized 
rules about the workings of ecology instead of digging into the muddy 
details of real-world management cases. Of course, in the same period, 
many real-world invasions were managed locally, but this case-specific 
management and associated expertise were treated as applied science of 
lower status and therefore the institutional and epistemological core of 
the discipline of invasion biology was not affected by how applicable its 
theory was to local, real-world cases. 

The example of invasive species science and policy illustrates how 
discipline-based policy advice - mode 1 knowledge production sensu 
Nowotny and colleagues” —is maintained through the social construction 
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of a whole regime of codependent cultural, social, institutional and epis- 
temological elements. To what extent this example of the social con- 
struction of proactive action in response to an environmental risk should 
be seen as a successful or problematic model for reducing scientific and 
social complexities to enable effective action against an emerging risk 
requires a differentiated assessment. Some of its accomplishments and 
weaknesses became evident when it started to break apart in the late 
1990s. This is the next phase of the story of invasive species science and 
management. 


Post-Normal Disturbances of the Expert Consensus 


Toward the end of the 1990s, the science-policy regime of invasive spe- 
cies research and policy increasingly ran into problems and dissent was 
voiced more loudly within the sciences and in society.’° The definitions of 
an alien and an invasive species were questioned by different experts and 
stakeholders,” and the whole problem framing as well as the science-policy 
regime were being challenged. What human-assisted extra-range disper- 
sal meant was no longer quite so clear. From how far must a species come 
so that its dispersal counts as extra-range? For instance, does the plant- 
ing of a species outside of its ecological habitat, but within the same geo- 
graphic area — for instance plantations of conifers that naturally occur 
in mountainous areas but are often planted in lowlands - also count 
as a case of extra-range and thus nonnative occurrence? Furthermore, 
is there a time duration after which a long-established nonnative species 
is considered a native species? And, when should a dispersal event be 
considered a human-assisted one? For instance, do species that migrate 
due to anthropogenic climate change, but without being transported by 
humans also count as nonnative species? After all, why is human assis- 
tance even a relevant dimension of a definition of an ecologically novel 
species? Especially in the Anthropocene, does a definition that considers 
humans separate from nature still make sense (Figure 4.1), or how can 
ecological novelty be better defined in a time of massive anthropogenic 
ecological changes?’ Such critique of the problem framing came from 
within invasion science and ecology — including new subfields such as 
global change ecology that had started to compete with invasion science 
for expert status on the same issues — as well as from diverse other disci- 
plines, including geography, social and cultural sciences, and from prac- 
titioners, stakeholders and decision makers.”? Thus, in line with Thomas 
Kuhn’s model of scientific revolutions, conceptual questions that had 
been treated as a taboo by the prevailing paradigm suddenly became 
the focus of scientific debate. These questions had occasionally been dis- 
cussed before in the scientific literature but did not receive much atten- 
tion, while now they led to energetic scientific correspondence among 
the leaders in the field. In the case of a real-world and policy-oriented 
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Figure 4.1 The Bosco Verticale building in Milan (Italy) - a high-rise build- 
ing planted with trees in an urbanized area. In the Anthropocene, 
human agency and man-made landscapes shape novel ecologies. 
Photograph by Christoph Kueffer. 


science, however, the post-normal phase was not confined to discus- 
sions among a small circle of specialized experts, but triggered more 
wide-ranging debates about evidence-based decision-making on biolog- 
ical invasions.50 

Indeed, the breakup of the paradigm opened space for more diverse 
expert perspectives.*! In particular, critical voices called for case-specific 
evaluations of actual invasions and their management instead of assum- 
ing that all alien species should be treated equally as a problem inde- 
pendent of context.52 As a result, a greater diversity of alternative policy 
options and expert advice became available, which made it more difficult 
to reach a consensus on management actions.** Furthermore, it was no 
longer possible to neglect the contingencies and context-dependencies of 
particular real-world invasions. Whether a particular mechanism is rel- 
evant in explaining a specific invasion depends on the ecological and 
anthropogenic context of the invasion.°* Invasion science theory was not 
particularly well prepared to explain how confounding factors shape 
real-world invasion dynamics.°° Thus, the scientific robustness of the 
available expert knowledge weakened. While broad expert consensus 
supported general theory about invasions, reliable predictions of the out- 
comes of specific invasions in particular contexts were more difficult to 
make. It also became more challenging to evaluate the impacts of par- 
ticular invasions and the cost-benefits of their management. 

One observation about the consequences of this post-normal distur- 
bance of the biological invasion science-policy regime is that strong 
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and incommensurable disagreements within an established scientific 
discipline led to division among experts from the same discipline and 
research field, who otherwise agreed on the validity of the underlying 
scientific theory and evidence. In 2011, for instance, Mark Davis and 
other ecologists published a fundamental critique of invasion science in 
the scientific journal Nature,°” which triggered strong responses from 
the community of invasion biologists.5% In the same time period, Davis 
published a textbook about invasion ecology that represented the main- 
stream thinking in the field;*’ and his coauthors were equally well rooted 
in mainstream ecology. Thus, although they taught the same science to 
their students, their interpretations of evidence became incommensu- 
rable with mainstream thinking. Davis et al. stated that “nativeness is 
not a sign of evolutionary fitness or of a species having positive effects”, 
thereby challenging the most fundamental pillar of the paradigm of 
invasion science.’ They also argued that “the conclusion made [...] 
that invaders are the second-greatest threat to the survival of threat- 
ened or endangered species after habitat destruction” was based on no 
empirical data. This mounted a fundamental challenge to the claims of 
invasion biologists in their role as policy advisors. Daniel Simberloff 
and Montserrat Vila, in their response entitled “141 scientists object”, 
emphasized that they represented the expert consensus and responded 
to the critique that empirical data was lacking by emphasizing the need 
for proactive action in line with the precautionary principle: “severe 
impact of non-native species [...] may not manifest for decades” and 
“some species may have only a subtle immediate impact but affect entire 
ecosystems, for example through their effect on soils”.”! Thus, while 
these different experts agreed on the nuts and bolts of the underlying 
science, they were forced into separate camps at the level of overarching 
perspectives on the science and policy of invasions. 

Indeed, perceptions of alien species and their management — whether 
by experts or those affected by an invasion - can be influenced by a 
wide range of factors, including the involved actors, the attitude toward 
the affected biodiversity and targeted invasive species, the social and 
cultural context of the invasion or terminologies.”? For instance, state- 
led actions against an alien species on private land might be opposed 
due to personal stances about the role of the state in solving problems. 
Depending on the framing of the problem, fault lines between support- 
ers and dissenting voices can shift radically. For instance, while there 
are many biological similarities between the ecological risks of inva- 
sive alien species and novel species engineered through biotechnology,” 
these two types of ecological risks are evaluated very differently by dif- 
ferent experts. Some experts see a high risk stemming from alien species 
but not from genetically modified organisms, and vice versa. Overall, 
examples of dissent related to biological invasions show that the reasons 
for disagreement are not necessarily linked to any inherent aspect of 
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biological invasions. Rather, who agrees or disagrees depends largely on 
how the problem is framed: Who is considered a relevant expert or actor, 
what the envisioned solutions are, who has a voice in the process of 
developing the problem understanding and solutions and how the prob- 
lem is communicated and by whom. 

This leads to another important observation. The great flexibility 
of forming alliances in support of an environmental cause is both an 
opportunity for and a threat to scientific experts. It highlights that trans- 
parent, inclusive and careful deliberations about the social, political, 
cultural, ethical and emotional dimensions of an environmental issue 
can be effectively employed to foster consensus. But it also leaves open 
the possibility that public support and perceptions will shift. Indeed, the 
perception of a particular alien species — for instance the tree genus 
Tamarix over the course of the 20‘ century in the United States - can 
change fundamentally.?* Such shifts in problem understandings can trig- 
ger a need for the rearrangement of the whole science-policy regime that 
interlinks scientific expertise, policy responses and public perceptions. 
New legislation might have to be formulated, new institutional arrange- 
ments financed, the public engaged through different communication 
strategies and practitioners might have to learn new management 
approaches. Such knock-on effects might cascade through science-policy 
regimes with time delays leading to asynchrony between expert think- 
ing and implemented solutions. In many places, policy-makers at local 
and national levels are currently implementing essentially the framing 
of invasive species management formulated in the 1980s and 1990s,” 
while some scientists have moved on and are now questioning whether 
these solutions are still effective. Furthermore, once one group of scien- 
tists loses its unquestioned status as the only relevant expert group on 
a particular issue, alternative science-policy regimes, all with their own 
temporal dynamics, can coexist with regard to the same policy issue. 
In the case of urban tree planting policies, for instance, there are two 
positions: The first calls for a native-species-preference policy (in line 
with invasive species science and policy),’ while the second calls for 
an alien-species-preference policy (in line with horticulture and urban 
design and with the goal of adapting to climate change). Which posi- 
tion is taken up by a particular city seems to be at least partly coinci- 
dental, although intermediate perspectives that bridge between the two 
positions have been formulated.* 

A further observation is that sometimes the reframing of a problem 
understanding can open space for more stable and less contested and 
therefore more effective science and policy approaches. This is indeed 
what happened in the case of biological invasions in the 1990s. In 1996, 
an inter- and transdisciplinary multi-stakeholder program focused on 
biological invasions - the Global Invasive Species Programme (GISP)” - 
was initiated.!% In the wake of the GISP, a new problem framing of 
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biological invasions developed in complement to the existing one!®! — 
so-called pathway or vector science.!% While the traditional framing 
of biological invasions aimed at understanding and managing the risks 
posed by particular alien species individually, pathway science aimed at 
understanding how different socioeconomic pathways led to the trans- 
portation of alien species across landscapes and continents. Thus, the 
focus of research shifted from understanding the biology of alien species 
to understanding the socioeconomics and practicalities of trade rela- 
tionships. This new focus enabled the development of targeted concepts 
and tools for mitigating ecological risks associated with different trans- 
port pathways, for instance, the transportation of aquatic organisms 
in ballast water in international shipping,!% or of plants in horticul- 
tural trade,!% leading to different scientific questions and policy options 
depending on pathway (Figure 4.2). In the case of ballast water - i.e. 
marine water that is transported in ships that are not fully packed with 
cargo to stabilize them - an effective risk mitigation strategy is to steri- 
lize the ballast water before releasing it back into the ocean at a port,!% 
while in the case of horticulture, the responsible use of alien species in 
garden design can be fine-tuned through close collaboration with actors 
in the green industry.!% This might mean that garden centers inform 
their clients about invasion risks, alien species are not planted in the 
vicinity of a nature reserve, or alien trees with known benefits for native 
pollinators are preferred in urban plantings over alien trees without bio- 
diversity benefits. Developing such fine-tuned solutions with experts and 
stakeholders from practice increases their acceptance and effectiveness. 


Figure 4.2 Lupinus polyphyllus is an ornamental plant that can form monospe- 
cific stands in cold environments as an alien species. Photograph by 
Christoph Kueffer. 
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Indeed, more generally, differentiating one overarching problem fram- 
ing into multiple context-specific ones can help to lead to more prag- 
matic and less ideological solutions, which are more effective and can 
be better integrated into existing institutional frameworks. Thus, path- 
way science is not a replacement for species-focused risk assessments but 
a complement. Preventing some particularly problematic alien species 
through border control and species-specific strategies may still be nec- 
essary alongside diverse additional measures implemented for different 
pathways. 

In summary, this phase of heightened evidence contestation in inva- 
sive species research and policy illustrates a fundamental dilemma of 
evidence-based environmental decision-making: When is generalized 
knowledge and expert consensus sufficient to legitimize action and 
when is it necessary to invest the time needed to collect case-specific 
evidence and allow for societal deliberation? Especially in cases when 
preventative and coordinated actions are needed, it is often not pos- 
sible to gain sufficient case-specific evidence by the time a decision is 
required, and inclusive and open-ended deliberations might not lead to 
coordinated action across large geographic spaces (e.g. at international 
levels) and among diverse stakeholders. However, the alternative — 
defending the consensus of a narrow group of experts as the sole basis 
for legitimizing decisions — is also problematic. To maintain such nar- 
rowly focused consensus among experts, there is a strong incentive to 
accommodate critique of the existing paradigm and keep the conceptual 
core of the research field as stable as possible.!% For instance, although 
it is increasingly evident that invasions are inherently driven by humans 
and can only be effectively addressed through approaches that inte- 
grate an ecological understanding with expertise on social and cultural 
dimensions,!% the social sciences are still of only marginal importance 
in the published literature on biological invasions.!% There is thus a risk 
that expertise is not adaptive enough to respond flexibly to dynamic, 
complex and ambiguous challenges. Secondly, the defense of narrowly 
framed expertise in a context of messy real-world realities and pluralism 
risks becoming ideological. Indeed, invasion biologists were increasingly 
confronted with such critiques. It was said that the concept of invasion 
“appeals to political and social values but has no scientific meaning”,!!° 
invasion biology was denounced as a pseudoscience,!!! it was suggested 
that scientists were demonizing certain alien species,!!? and invasion 
biologists were criticized for promoting their views in rhetoric redolent 
of xenophobic nationalism.!" 

Invasion biologists have in recent years attempted to walk the line 
between defending their established problem framing and giving space 
to a greater diversity of voices. Franz Essl et al.''* argue that “many con- 
flicts in the valuation of the impacts of alien species are attributable to 
differences in the framing of the issue and implicit assumptions” and they 
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propose principles to make valuation of alien species impacts more 
socially robust. They refer to Roger Pielke’s model of the honest bro- 
ker,'!5 thereby accepting the need for participatory deliberation but 
maintaining that ultimately “science must play a central role in provid- 
ing information and advice to policymakers”. This reflects a more gen- 
eral development in the environmental sciences and policy toward more 
inclusive and reflective decision-making frameworks,!!6 processes!” and 
policy and academic institutions,!'* inter- and transdisciplinary research 
processes,'!? adaptive management and social learning processes,!2 and 
training environmental scientists in the skills necessary for participatory 
and integrative approaches. !7! 


Rethinking Ecology and Environmental Decision-Making 
for the Anthropocene 


The case study could end here. But the story has continued. In recent 
years, the awareness has grown that the reshuffling of species commu- 
nities through anthropogenic interference leads to fundamentally novel 
ecologies of the Anthropocene, so-called ecological novelty.'2* Not only 
biological invasions and alien species contribute to it, but all sorts of 
other global change drivers: Land use changes, urbanization, climate 
change, extinctions, rapid evolutionary responses to an anthropogenic 
world and biotechnology. Positions among experts range widely from 
rigid preservationists’ views that hope to reverse the trend toward eco- 
logical novelty!” to pragmatic ones that call for a balanced approach'** 
and optimistic ones that see a new biodiversity of the Anthropocene 
emerging.!?* Fault lines in the debates shift. Some conservationists 
don’t judge alien species by default as problematic anymore but rather 
try to find ways to weigh their positive and negative sides depending 
on context. So-called novel ecosystems characterized by alien species 
are considered an integral part of and sometimes an opportunity for 
nature conservation.'*° Alien species are considered to play important 
roles in wild to anthropogenic ecosystems, including by supporting the 
ecoevolutionary adaptation of species communities to novel ecologies.!27 
Conservationists promote the deliberate transportation of alien spe- 
cies to new biogeographic regions to replace the ecological functions 
of extinct species (re-wilding)'?° or to help species track climate change 
in space (assisted migration).'2° Collaborations between conservationists 
and biotechnologists look into possibilities to resurrect extinct species, 
adapt threatened species through gene-editing to a changing environ- 
ment, control invasive species through biotechnology, or release syn- 
thetic organisms to clean up pollution.!30 There is almost a feeling of 
anything goes. 

In this highly ambiguous and dynamic situation, the current strat- 
egy of environmental science and policy to enable consensus building 
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through inclusive deliberation processes has limits. We might have to 
fundamentally rethink what robust evidence about complex and socially 
contested environmental problems entails, and what role it should 
play in legitimizing environmentally responsible coordinated action. 
Heterogeneous and context-specific ecological knowledge, which 
cannot easily be generalized, should become a more central pillar of 
evidence-based decision-making. Invasion scientists have for instance 
started to adopt strategies such as the identification of syndromes to 
generalize knowledge in a more context-sensitive way.'?! However, these 
strategies might not suffice to effectively use locally rooted evidence at 
national and international scales and in decision-making contexts where 
vested interests play a dominant role, i.e. in situations where evidence 
is exposed to the manufacturing of truth and communication cam- 
paigns of interest groups or more generally alternative facts and fake 
news. Rather than adhering to an unrealistic ideal of irrefutable facts 
that can be defended against vested interests as a necessary condition for 
environmental valuation and actions, the task of clarifying the evidence 
basis of environmental issues should emphasize a continuous process 
of nurturing critical thinking based on society-wide ecological compe- 
tencies and rooted in a shared ecological ethic.!% Such a reappraisal of 
situated ecological knowledge challenges the established hierarchy of 
knowledge within ecology that attributes higher status to universal than 
case-specific ecological knowledge. Supported by work in social studies 
of science and epistemology, we must move toward an expert culture of 
real-world ecological expertise that cherishes the full diversity of ecolog- 
ical knowledge, competence and sensibilities: Of field ecologists as much 
as of experimental ecologists and system modelers, and of practitioners, 
amateur naturalists and holders of traditional and indigenous knowl- 
edge as much as of academic ecologists. It has been shown that case- 
specific integration of diverse evidence can lead to more robust invasive 
species policies and management.'?3 

Furthermore, given that in the Anthropocene ecological processes are 
interwoven with human activities, ecological expertise must become 
inherently inter- and transdisciplinary and especially build on close col- 
laborations with the social and cultural sciences. Biological invasions are 
by definition human-associated ecological phenomena and they play out 
in man-made ecosystems and landscapes, and therefore biological inva- 
sions can only be understood robustly and addressed effectively based 
on interdisciplinary perspectives that integrate biology with landscape 
sciences and the social sciences and humanities.!5+ One reason why eco- 
logical novelty seems so difficult to grasp is that current research does 
not address it as an inherently socioecological phenomenon. 

Ultimately, improving only the evidence base for understanding a 
messy world will not suffice to deal with the novel ecological realities of 
the Anthropocene. Foremost we are faced with a lack of shared values 
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Figure 4.3 Caretaking for nature. In the Terra Nostra gardens in the Azores 
(Portugal), plants from around the world are combined to design 
novel ecosystems, while on oceanic islands, also many remaining 
fragments of “wild” habitat depend on continuous weeding and 
re-planting. Photograph by Christoph Kueffer. 


and visions: What are good human-nature relationships and what are 
realistic goals for ecological regeneration in the Anthropocene? We have 
to address a deficiency in our culture to engage in rich social, cultural, 
emotional and cognitive ways with our ecological environment and to 
express our deep dependence on nature ( ). Engaging with eco- 
logical novelty might thus require us to rethink how we can responsibly 
care for the degraded ecosystems of the Anthropocene and their mani- 
fold living beings, with the aim to regenerate their functioning, instead 
of using invasive species as scapegoats for the inevitable consequences of 
environmental destruction. 


Conclusions 


Through the prism of invasive species research and policy, a rich pic- 
ture of ecological research practices and associated environmental 
decision-making in the 20" century emerges. It is evident that the dis- 
ciplinary and mode 1 science-policy approach employed by ecologists 
after World War II has limits in a pluralistic world and on a planet 
characterized by a perfect storm of environmental crises. A disciplinary 


120 Christoph Kueffer 


problem framing does not do justice to the socioecological phenomena 
of the Anthropocene, and the monopolization of expert power by an 
exclusive circle of academics trained at and employed by natural science 
departments of universities in the Global North lacks legitimization in 
a globalized, post-colonial world. Building policy advice on generalized 
ecological knowledge risks ineffective solutions and imposing normative 
positions and ontological assumptions held by a small social group on 
holders of diverse values, worldviews, ontologies and interests. 

However, there are no easy solutions. General ecological knowledge 
and expert judgments about the well-functioning of ecosystems must 
play an important role in societal decision-making to enable proactive 
and coordinated environmental action. We cannot found decisions on 
case-specific empirical data and deliberations in every single manage- 
ment case. It is evident that some ecosystems have higher ecological 
qualities than others and that modern forms of land use destroy ecolog- 
ical qualities. It is also evident that certain academic and non-academic 
experts have a more in-depth understanding of ecology than the rest of 
society — especially in our era, when many citizens live a life isolated from 
nature. We must find new ways to interweave ecological knowledge with 
cultural and social practices, narratives, norms and our personal lives. 
In pre-modern times, ecological knowledge was embedded in mytholo- 
gies and everyday life, and in the early days of the Enlightenment period, 
the boundaries between storytelling, the arts and the social and cultural 
sciences on the one hand and ecology on the other were still permeable. 
Thereafter, fears of biological determinism and naturalistic fallacies and 
of anthropomorphism and a loss of scientific objectivity were easy ways 
out of sometimes difficult inter- and transdisciplinary conversations 
between the natural and human sciences. We cannot afford to avoid 
such a dialogue anymore. 
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with Evidence 


Epistemology and Ethics of Perioperative 
Hygiene Measures 


Saana Jukola and Mariacarla Gadebusch Bondio 


In this chapter, we review the debate concerning the hygienic function 
of protective clothing in surgical operating theaters. In particular, we 
analyze the so-called bouffant scandal,! a debate which erupted in 2014 
after the Association of periOperative Registered Nurses (AORN) 
issued new guidelines for surgical attire in the perioperative setting. The 
guideline’s recommendation concerning head covers sparked a fierce 
debate between the AORN, the American College of Surgeons (ACS) 
and clinicians about how to best protect surgical patients from infec- 
tions. A central question in this debate was what type and quality of 
evidence is needed for issuing new policies and practices in the clinical 
hygienic setting. We illustrate how different epistemic values (e.g., accu- 
racy, internal validity and scope) and non-epistemic (e.g., political and 
ethical) values and background assumptions can lead to disagreements 
concerning evidence and guidelines.” In this way, we demonstrate one 
way that de-stabilization and questioning the relevance of evidence can 
take place. Our aim is to use this case to show how philosophical analy- 
sis can help to pinpoint the roles that calls for evidence play in scientific 
controversies — not only in medicine but also more broadly. 

Surgical site infections (SSIs) are associated with significant mortal- 
ity and morbidity and, consequently, increased healthcare costs and 
impaired quality of life.* Different kinds of interventions are used in 
healthcare facilities for preventing infections, ranging from hand 
hygiene, environmental cleaning and disinfection to prophylactic use of 
antibiotics.* Since Evidence-based Medicine (EBM) has become the dom- 
inant approach to biomedical research and practice, there have been, on 
the one hand, an increased demand for high-quality evidence for the 
effectiveness and safety of hygiene measures in surgery and perioper- 
ative care, and, on the other hand, passionate discussions about where 
the threshold of sufficient evidence should be in this context.’ The debate 
on surgical hats demonstrates how references to the EBM standards of 
evidence can function both as a regulatory epistemic ideal against which 
empirical bases of recommended measures are assessed and as a rhetor- 
ical tool for undermining an opponent’s position. 
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The controversy that became known as the bouffant scandal began in 
November 2014 after the publication of the AORN’s guidelines for sur- 
gical attire in the perioperative setting. The main purpose of the guide- 
lines was to reduce the rate of SSIs and shield patients from exposure to 
microorganisms.° They gave directions, for example, as to which fabrics 
should be used for scrubs, how arms should be covered completely in 
operating rooms and how jewelry should either be covered or removed 
during surgical operations.” However, the part of the publication that 
attracted most attention was the section on head covers. It was namely 
stated that any person who enters an operating room should wear “a 
clean surgical head cover (e.g., bouffant cap) or hood that confines all 
hair and completely covers the ears, scalp, sideburns, and nape of the 
neck”.® This suggestion caused concern among many members of the 
surgical community because the recommendation would effectively 
imply banning the use of the traditional surgical headwear, the skull cap 
(see Figure 5.1 (A) for a picture of the bouffant hat and Figure 5.1 (B) for 
the skull cap). The skull cap is a close-fitting cap leaving the ears largely 
uncovered as well as some of the hair, especially in the back of the head. 
The surgeons’ concerns about losing the skull cap that is “symbolic of the 
surgical profession”? came true - albeit temporarily!0 - when the AORN 
recommendations were enforced as regulations by accrediting bodies.!! 
The Joint Commission on Accreditation of Healthcare Organizations 
(JCAHO), which is responsible for accrediting hospitals in the US, as 
well as the leadership of many hospitals, banned skull caps from oper- 
ating rooms.!? This meant that healthcare workers, including surgeons, 
had to wear either an astro bonnet (see Figure 5.1 (C)) or a bouffant hat, 
which is a loose cap that is secured around the hair with an elastic band. 

The publication of the AORN guidelines was followed by an imme- 
diate and rather heated response from the ACS and the surgical com- 
munity.'3 In the debate, the evidential basis of the recommendation to 
cover all hair for hygiene reasons was questioned and new studies on the 
effectiveness of different hat types and materials in preventing infections 


A 


Figure 5.1 (A) A bouffant hat. (B) A skull cap. (C) An astro bonnet. Illustration 
by Guido I. Prieto. 
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were conducted. In addition to criticizing the evidential basis of the new 
recommendation, the opponents of the AORN guidelines raised con- 
cerns about cost effectiveness and the environmental impacts of requir- 
ing the use of bouffant hats. The American College of Surgeons also 
emphasized the symbolic nature of the skull cap. 

In the following sections, we will explore some central questions that 
arose in this debate and reflect on their philosophical underpinnings and 
implications. The analysis will not only help to identify argumentative 
patterns in this particular debate but also in similarly framed disputes over 
evidence in future. We first review the evidence that was referred to by the 
AORN and their critics by examining research articles and commentaries 
published on the debate. We then analyze the philosophical background 
assumptions that contributed to the emergence of the disagreement. In 
particular, by drawing on previous accounts in philosophy of medicine, 
we will show that the participants in the discussion, on the one hand, 
had divergent ideals concerning adequate evidence and how to establish 
claims about causation and, on the other hand, relied on different under- 
standings of the goal of the preventative guidelines, which motivated con- 
ducting studies with different endpoints. After this, we briefly discuss the 
role of different non-epistemic concerns in the debate about the AORN 
guidelines. The aim of this section is to show how evidence and epis- 
temic concerns alone do not determine what recommendations should be 
given — practical, ethical and political factors contribute to the content of 
the guidelines and can spark controversies. In the last substantial section, 
we broaden the perspective to Germany, where the surgical community 
has accepted the introduction of new hygienic measures with pragma- 
tism.'* This comparison allows us to identify and highlight the specifics of 
the discussion that was sparked in the US before we come to a conclusion. 


Evidence and Epistemic Background Assumptions 
in the Bouffant Scandal 


The aim of this section is to articulate how different non-empirical 
assumptions contributed to the debate between the AORN and the oppo- 
nents of enforcing the guidelines.!5 After providing an overview of how 
evidence was debated, we will first discuss the ideals of evidence that 
influenced the discussion. We finish the section by arguing that distinct 
understandings of the aims of hygiene control and conceptualizations of 
the problem at hand added to the disagreement. 


Evidence on the Role of Surgical Hats in Infection Control 


The debate about surgical headwear centered around the question of 
what could be inferred from studies that the AORN cited. As the authors 
of the guidelines acknowledged, the available evidence on surgical wear 
was limited. They also admitted that no randomized controlled trials 


144 Saana Jukola and Mariacarla Gadebusch Bondio 


(RCTs) or systematic reviews show that there is a “direct causal relation- 
ship between surgical attire and surgical site infections (SSI)”.16 Instead 
of experimental or epidemiological studies on the connection between 
different hat types worn in the operating room and the number of infec- 
tions, the guidelines referred to studies showing that the primary source 
of bacteria in air in operating rooms is the skin and hair of healthcare 
workers.” These studies were taken to imply that bacteria could get into 
open wounds of patients after becoming airborne when skin squames 
are rubbed off.'® In addition to these studies, the guidelines cited a case 
report in which psoriatic scalp lesions of an operating room technician 
were linked to 20 postoperative wound infections.!? This study of a local 
infection outbreak demonstrated that pathogen transmission from an 
infected healthcare worker to a patient was indeed possible. 

Many of the commentaries made the critics’ disparaging attitude 
toward this evidential basis of the AORN guidelines evident. For exam- 
ple, Matthew Bartek, Francys Verdial and E. Patchen Dellinger use scare 
quotes when referring to the studies quoted in the AORN guidelines: 
“Interestingly, the only ‘evidence’ cited by the AORN for covering the 
ears and every last bit of hair is that they contain bacteria that might fall 
into the surgical wound”.*° Similarly, surgeon and blogger David Gorski 
commented that “despite invoking ‘evidence-based’ definitions, notice 
that AORN didn’t cite any actual...oh, you know...evidence to show that 
wearing surgical skull caps is associated with an increased SSI rate”.?! 
The core criticism was that evidence of hair and skin carrying bacte- 
ria and a case report linking a healthcare worker to infections was not 
enough to justify a recommendation that would change an established 
practice. Instead, evidence showing an association between covering all 
hair and reduced SSIs rates would be needed before a recommendation 
to cover all hair could be given. Consequently, the critics of the AORN 
guidelines conducted several observational studies to investigate whether 
there is a connection between the kind of headwear and SSI rates - in 
other words, if wearing a bouffant hat is more effective in preventing SSIs 
than wearing a skull cap.” For example, Hussain Shallwani et al. ana- 
lyzed SSI data from 13 months before and 13 months after the mandatory 
use of bouffant hats was issued to see whether the policy change had an 
impact on the infection rates. The outcome of this and other published 
studies was that the type of hat did not correlate with SSI rates. 

In addition to the observational studies, a quasi-experimental study on 
different hats and hat materials was carried out. Troy A. Markel et al. 
examined how the type of headwear worn in a one hour long mock sur- 
gery affects air particle counts.” The study assessed both airborne partic- 
ulate contamination, microbial contamination (by active air samples and 
passive settle plate assessment) and the physical attributes (permeability, 
penetrability, thickness and porosity) of different hats. Results from this 
study indicated that disposable bouffant hats were not better in “regard 
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to particle or actively sampled microbial contamination” than dispos- 
able or cloth skull caps.”* Markel et al. acknowledged that their study 
had several limitations, such as neither being blinded nor randomized 
and not comparing headwear in an actual operation. Yet they took 
its outcomes to contradict the claim that the bouffant hat would pre- 
vent particle contamination more effectively than the skull cap.” The 
results from this study were later cited in articles arguing that there is no 
evidence to support the recommendation to cover all hair as a means to 
prevent SSIs. For instance, by citing the results of Markel et al., David 
N. Naumann et al. state that the use of bouffant hats comes with “a 
potential increased risk of SSIs”.26 

Thus, the parties in the debate both referred to empirical evidence, yet 
they disagreed on what could be inferred from the available evidence. 
For the AORN, the established fact that scalp and hair are carriers of 
bacteria means that there is a risk of potential transmission to open 
wounds. The case report of an incident where SSIs had been connected 
to the presence of an infection-carrying staff member supported the 
conclusion that contamination could indeed happen in this way. This 
possibility, in turn, justifies the need for covering all hair. At the same 
time, critics of the AORN guidelines argued that the evidence referred 
to by the AORN did not warrant the claim that covering all hair could 
help to reduce SSIs. The evidence cited by the AORN is evidence of a 
possible mechanism of contamination potentially leading to SSIs. What 
is missing, according to the critics, is support for the claim that cover- 
ing all hair actually correlates with reduced rates of SSIs. Consequently, 
according to the skeptics, the cited evidence could not warrant the rec- 
ommendation to use headwear covering all hair.” 


The Role of Epistemic Background Assumptions 
in Evidence Evaluation 


On the face of it, the debate about the surgical hats appears to be a typical 
scientific controversy about prevention measures, in which weaknesses 
in the empirical evidence presented by one side of the dispute are criti- 
cized by the other side. What is interesting is that in this case the critics 
did not question the outcomes of the studies referred to by the AORN. 
What they disagreed about were the conclusions that could be drawn 
on the basis of these outcomes. What were the reasons for this disagree- 
ment? A philosophical analysis will help to reveal them: The parties’ 
evidential reasoning relied on partially conflicting assumptions. In what 
follows, we focus on two differences in the background assumptions 
of the discussants: The first tension concerns implicit epistemological 
views of how a causal connection can be established and more explicit 
positions concerning what the standards of adequate evidence are. The 
second disagreement is related to how the problem of infection control 
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should be understood and, relatedly, whether the studies should measure 
infection rates or pathogen counts. We discuss these in turn. 

The AORN’s recommendation to cover all hair in the operating room 
was based on studies reporting hair and skin of the healthcare workers 
being a main source of pathogens. It is noteworthy that the critics of the 
AORN guidelines did not question these studies or try to deny the case 
report about infections being linked to the presence of a staff member 
with psoriasis. What they disagreed on was what kind of conclusions 
could be drawn on the basis of this evidence. In this sense, the criti- 
cism of the evidential basis of the AORN recommendation (i.e. of the 
studies showing hair and skin being colonized with bacteria and path- 
ogens becoming airborne on skin squames, as well as the case reports 
of incidents in which the presence of an infected staff member could be 
linked to a number of SSIs) follows the lines of argument that are typical 
in the epistemological framework of EBM.?® From time to time, appeals 
to the ideals of EBM are explicitly made in the debate. For example, 
when Naumann et al. criticized the enforcement of the AORN guide- 
lines as a regulation, they declared that “[t]hose with such authority 
[to enforce regulation] have a responsibility to lead the way with true 
evidence-based policies”.2? However, our analysis of the statements that 
were made in the debate shows that the EBM ideals were appealed to 
also more implicitly. 

According to the tenets of EBM, clinical practice should be based as 
far as possible on systematic scientific evidence. However, not all types 
of evidence are taken to be equal. The quality of the available scientific 
evidence is evaluated according to the ranking that is represented by 
the evidence hierarchy. In this hierarchy, RCTs, systematic reviews and 
meta-analyses of RCTs are placed at the top. Observational studies (e.g., 
cohort studies and case-control studies) are in the middle of the hierar- 
chy, while laboratory research and anecdotal evidence (e.g., case reports) 
are thought to provide the weakest evidence. When the available evi- 
dence relevant for solving a question (concerning, for example, the effi- 
cacy of a drug) is conflicting, the evidence originating from study types 
placed higher on the hierarchy trumps the lower level evidence.*° 

It is worth noting that these EBM ideals of evaluating evidence have 
become common in other fields outside clinical context. For example, 
nutrition research is often criticized because RCTs are seldom conducted 
in the field.*! In the area of public decision-making, evidence-based pol- 
icy refers to the idea that decisions should be based on empirical evi- 
dence, preferably data from RCTs.*? 

But what is the justification for ranking evidence according to the evi- 
dence hierarchy? It has been pointed out that this hierarchical ranking of 
study types is based on an epistemological premise, namely that internal 
validity is the most important epistemic value.’ Internal validity refers 
to the degree to which the results of the study are accurate to the subjects 
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included in the study.** In RCTs, controlling for the effects of biasing 
factors is considered to be possible as long as studies are properly rand- 
omized and blinded.” Contrarily, making claims on the basis of study 
types lower in the hierarchy comes with the risk of confounding and bias 
of different types. Consequently, on the basis of this criterion, RCTs are 
taken to provide better evidence than study types lower in the hierarchy. 

As scholars applying insights from the philosophy of causality on 
medical methodology have shown, the EBM ranking of evidence is 
related to a particular view about how much we need to know about 
the process that connects interventions to their claimed effects in order 
to make causal claims.*° According to these scholars, laboratory and 
case study evidence is discounted because mechanistic evidence, i.e. evi- 
dence about “entities and activities organized in such a way that they 
are responsible for the phenomenon”, in general is discounted in EBM. 
According to the EBM framework, if an RCT shows that an intervention 
has an effect X, we do not need information about why X happens in 
order to state that the intervention truly has an effect X. Consequently, 
the study types highest on the evidence hierarchy produce statistical evi- 
dence about average effects in populations without necessarily increasing 
understanding of why the effect happens. In this framing, evidence of a 
possible mechanism without statistical evidence is simply not enough to 
warrant causal claims.** 

The debate raised by the publication of the AORN guidelines is thus 
an example of a clash of two epistemological frameworks and sets of 
epistemological assertations about what evidence is sufficient for mak- 
ing claims about causation. The evidence that the AORN based their 
recommendation on was mainly mechanistic: The studies indicated a 
potential mechanism that is a part of a causal path through which SSIs 
might occur: Bacteria becoming airborne and being transferred to a 
patient via skin squames and thus infecting the patient. On the other 
hand, the criticism raised by the ACS, Bartek, Verdial and Dellinger 
and other commentators shows adherence to the EBM framework, in 
which statistical evidence about the relation between the intervention 
and outcome is required.* Similarly, individual case reports are thought 
to provide only anecdotal evidence, which cannot be extrapolated to 
new cases. Consequently, these critics devalue the relevance of the evi- 
dence the AORN guidelines cited in support of the policy to cover all 
hair in operating rooms. 

Adherence to the EBM ideals is also apparent in how the critics of the 
AORN guidelines responded by conducting their own epidemiological 
studies. Many proponents of the tenets of EBM are generally suspicious 
of evidence from non-experimental epidemiological studies, given that 
they cannot control for confounding factors. However, the studies on 
the association between the type of surgical headwear and the rate of 
SSIs (conducted, e.g., by Ivy N. Haskins et al. and Hussain Shallwani 
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et al.) are taken to trump the evidence presented by the AORN, because 
observational studies are ranked higher in the evidence hierarchy than 
laboratory evidence (in this case showing, e.g., that hair is colonized 
with bacteria) and case reports of infection outbreaks. 

In addition to differences in the criteria for adequate types of evidence 
for making causal claims, an analysis of the articles published during 
and after the bouffant scandal shows differences also in how the pur- 
pose of hygiene guidelines — and thus the whole debate - was framed. 
When describing the need of guidelines for hygiene measures in periop- 
erative context, Leslie Bourdon writes: 


Although research related to surgical attire is limited and no ran- 
domized controlled trials or systematic reviews show a direct 
causal relationship between surgical attire and surgical site infec- 
tions (SSIs), increased numbers of microorganisms in the periop- 
erative setting increase the patient’s risk of SSI. Thus, health care 
workers should make efforts to reduce the patient’s exposure to 
microorganisms by following the RP [recommended practices] for 
surgical attire.*! 


As this quote shows, the AORN was not only interested in the preven- 
tion of SSI. Also the increase in the number of pathogens in the periop- 
erative setting was considered to be problematic — because the presence 
of pathogens in the environment was taken to be a link in the causal 
chain leading to infections. From this perspective, studies reporting the 
main source of bacteria in the operating room being the skin and hair 
of healthcare workers were relevant. For their part, the critics of the 
guidelines were focused on the number of SSIs and assessing the claim 
that there is an association between the type of the surgical wear and 
infection rates. This emphasis on measuring infection rate — not the 
number or the spread of bacteria — is distinctive of EBM, in which the 
importance of assessing the effect of different healthcare practices on 
clinical events (e.g., morbidity, mortality) is emphasized.* This shift in 
the focus on what is being measured becomes evident when surveying 
the outcomes used in the studies critical of the AORN guidelines. For 
example, Shallwani et al. compared the numbers of SSIs before and after 
the policy change.* Similarly, Haskins et al., Bradley W. Wills et al. as 
well as Arturo J. Rios-Diaz et al. had the SSI rate as their main outcome 
measure.** The study by Markel et al. was an exception to this rule as 
it assessed the claim that the hat type influences particulate and bacte- 
rial contamination in the environment.* Apart from this one study, the 
focus of critics of the AORN guidelines was on a different question than 
that which the AORN sought to address. 

The analysis of explicit criteria and implicit suppositions in the debate 
concerning surgical hats shows how evidential reasoning relies on diverse 
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background assumptions, some of which may be epistemological and 
conceptual in nature.* In the light of different background assumptions, 
it is possible for individuals to agree on facts (e.g., hair being colonized 
by bacteria) but disagree on what inferences should be drawn from those 
facts.* The criticism of the AORN guidelines was partially based on 
epistemological premises central to EBM, namely that internal valid- 
ity is the most important epistemic value and that statistical evidence 
trumps evidence about possible mechanisms. Likewise, the critics’ fram- 
ing of the problem of hygiene control differed from that of the AORN: 
While the AORN saw preventing the spread of pathogens as a central 
task, the focus of the critics was on SSI reduction. Consequently, the 
available case reports (the empirical results of which according to the 
EBM understanding cannot be generalized) and the evidence concerning 
a possible mechanism of pathogen transmission were discounted. 

Now that we have outlined the epistemological sources of the disa- 
greement, it is worth considering briefly on what evidence guidelines 
for hygiene measures should - and could - be based on. In our analysis 
of EBM criteria, randomized testing of the effectiveness of preventive 
interventions presents a particular challenge because of the complexity 
of the transmission pathways and the number of possible agents. Yet the 
need to develop applicable guidelines that combine available evidence 
with expert knowledge is ethically imperative in the interest of patient 
safety. The particular difficulty of developing just such guidelines for 
the prevention of SSI in the surgical context was also highlighted by the 
WHO in 2016.48 Observational studies, especially retrospective studies, 
in turn, are vulnerable to confounding and bias caused by, for example, 
the choice of controls in the study.*? Taking note of the fact that all study 
types have their weaknesses (either in general or in particular contexts), 
philosophers have argued for a more pluralistic and broader notion of 
evidence.” Different methods can provide valuable information about 
the relation of an intervention, its (un)suspected effect or how the 
effect takes place. This implies that a more context-sensitive approach 
to evidence evaluation is needed. Instead of categorically labeling evi- 
dence from certain study types as conclusive or too weak, it would be 
important to consider what the relevant questions are and which meth- 
ods could best provide answers to these particular questions in a given 
context. Moreover, given that all methods have weaknesses, acquiring 
evidence from different sources and different methods to inform practi- 
cal decision-making would be recommendable. For example, mechanistic 
evidence from laboratory studies together with evidence from observa- 
tional studies or RCTs can help to determine whether an intervention 
works more reliably than evidence from an RCT alone.*! A potential 
tool for evaluating and amalgamating evidence from different sources is 
a framework developed by Jiirgen Landes, Barbara Osimani and Roland 
Poellinger.’ By drawing on Austin Bradford Hill’s views on causality 
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and the Bayesian net approach, their method permits utilizing diverse 
sources of evidence for assessing causal claims.” The tool enables cal- 
culating the probability of a causal hypothesis on the basis of available 
data and updating the estimate as new evidence becomes available.*+ 
These innovative approaches seem to offer a viable and promising means 
of evidence evaluation, particularly for the area of hygienic prevention 
measures and their validation. 


Non-Epistemic Concerns in the Bouffant Scandal 


In the previous section, we outlined how different epistemic assumptions 
influenced evidence production and evaluation in the so-called bouffant 
scandal. In this section, we explain briefly how non-epistemic concerns 
influenced the debate. Issuing guidelines that are expected to affect prac- 
tice is not only a matter of following the evidence.’ As has been argued 
before, evidence and epistemic concerns alone cannot determine what 
normative rules, such as guidelines or policies, should be established in 
the clinical or other practical settings.‘ If there is “no ought from is”, 
as famously argued by David Hume, it is the case that even when the 
strongest evidence demonstrates the efficacy of an intervention, we need 
additional normative premises to come to the conclusion that the inter- 
vention should be recommended or used.s” These premises can include, 
for instance, the desirability of mitigating the symptoms of or prevent- 
ing a disease. A further reason for stating that non-epistemic concerns 
are integral in guideline production is the observation that aiming at 
the clinical and ethical goals of healthcare (cure, care, justice, etc.) 
under current limited resources requires balancing possibly achievable 
health-related goods with other societal goods.°* For example, when 
guidelines aiming at preventing SSIs are issued, the experts have to con- 
sider whether a certain policy - even if the available evidence supports 
the claim of its efficacy - would require too many resources and hinder 
implementing other policies considered important. Moreover, the social 
acceptability and practicality of a given recommendation have to be 
considered.’’ As a rather amusing example of this, Bartek, Verdial and 
Dellinger note that despite there being evidence indicating that women 
shed less bacteria than men and that naked men shed less bacteria than 
men wearing scrubs, no one has suggested that (clothed) men should be 
banned from entering operating rooms.‘ Giving a practical recommen- 
dation thus involves balancing different practical and ethical concerns 
with evidential considerations. These non-epistemic concerns, then, can 
cause debate in the same way as the evidence used. 

In the debate concerning surgical hats, critics of the AORN guidelines 
appealed to different non-epistemic concerns, which, according to them, 
spoke against enforcing the new bouffant policy. First of these was cost 
efficiency. This is understandable in the light of the dual role that clinical 
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guidelines serve: On the one hand, it is hoped that grounding practices 
in scientific evidence is expected to work as means of quality control. 
On the other hand, demanding that practitioners follow guidelines will 
save resources.*! Consequently, for instance, Radwan Dipp Ramos and 
Kamal Itani point out the increased costs of following the AORN rec- 
ommendation to wear long-sleeved surgical jackets. In a similar man- 
ner, Naumann et al. criticize the bouffant policy for increasing costs. It 
is noteworthy that the concerns about the increasing costs do not appear 
to be well-founded. For example, a question left open by Naumann et 
al. is whether the costs of bouffant hats exceed the costs of skull caps. 
Moreover, in their retrospective study, Wills et al. report bouffant hats 
to have been “57.14% less expensive than surgical skull caps”.°* 

In addition to the costs, environmental concerns were also raised in 
the debate. For instance, Naumann et al. write: “[the new] policy has the 
unintended consequence of environmental damage because these caps 
are not biodegradable”.°% However, as these authors do not compare the 
environmental impact of the bouffant hats with that of the skull cap, it 
remains an open question whether the environmental harms of bouffant 
hats really are greater than those of the skull caps. 

A third non-epistemic concern that was explicitly invoked in the 
debate was professional autonomy. Requiring new practices (e.g., 
wearing a bouffant hat instead of a classical surgical skull cap) was 
claimed to burden the professionals‘ and lead to the disappearance 
of a hat “symbolic of the surgical profession”.6’ In these commentar- 
ies, the enforcement of the AORN guidelines and the following ban of 
skull cap is presented as a disruption of tradition and taking away the 
agency of a professional group.‘ Similar resistant reactions to guide- 
lines have been reported in previous literature. For instance, Zhicheng 
Wang, Lisa Bero and Quinn Grundy discuss how experienced violation 
of clinical and professional autonomy contributed to Canadian radi- 
ologists resisting the implementation of new breast cancer screening 
guidelines in 2018.% According to them, fierce debates about guidelines 
are often political in nature in the sense that professional groups want 
their group interests to be reflected in the guidelines.” A failure to take 
these interests into consideration when the guidelines are formulated 
can lead to resistance. The statement by the ACS emphasizing the sta- 
tus of the skull cap as “the symbol” of the professional highlights how 
the bouffant debate was not only about the most effective means of 
preventing infections but also about the means that surgeons have for 
presenting themselves as a group with a shared identity.” 

Reactions to preventive recommendations, guidelines or orders can- 
not be characterized solely in terms of their epistemic vs. non-epistemic 
content. Cultural factors, political, ethical and professional frameworks 
also shape responses within the scientific community and the pro- 
fessional groups concerned. In the bouffant debate, non-epistemic 
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considerations, for example, cost efficiency, environmental burden and 
professional autonomy of the surgeons, are not presented as challenging 
evidential considerations but invoked as additional reasons for opposing 
the enforcement of the guidelines. If, for example, ethically significant 
aspects, such as responsibility toward vulnerable individuals in the oper- 
ating theater or the duty to provide the highest level of protection, had 
been considered, different weightings could have resulted. This high- 
lights a point previously argued for by numerous scholars: Evidence- 
based decision-making and guidance are permeated by non-epistemic 
concerns and evidence alone does not determine which course of action 
should be taken.7? Consequently, the disagreements concerning guide- 
lines often cannot be reduced to disagreements about (empirical) evi- 
dence. This can be observed also in other contexts. For example, during 
the COVID-19 pandemic, the recommendations concerning masks 
have varied between countries and jurisdictions despite the existing 
evidence being globally available.” Similarly, regional differences in 
adherence and resistance to these policies have varied, and a connection 
between cultural values and mask use has been observed.” In a like 
manner, experts preparing population-level nutrition guidelines have to 
consider, for example, local customs and agriculture in addition to the 
existing science. Consequently, the debates about dietary recommenda- 
tions are not restricted to evidentiary questions but include arguments 
that are ethical and political in nature.” 


Comparing the US and German Guidelines 


In the previous two sections, we have pinpointed reasons that contrib- 
uted to the emergence of the bouffant debate. Next, we contrast this 
debate with the German discussion related to the role of surgical hats in 
infection control. This comparison clarifies how differences in institu- 
tional settings and participating groups can shape discourses even when 
the available evidence is the same. 

It is noteworthy that in Germany there has been no debate about sur- 
gical headwear even after the bouffant scandal took place in the US. 
Moreover, many of the views of the German surgical community are 
more in line with the AORN than the ACS. An article published in the 
Deutsches Arzteblatt in 2019 gets to the heart of the matter: “If one 
knows that the ears are the most likely to harbor bacteria, then the only 
consequence can be a general obligation to use astro-bonnets [headwear 
covering all hair and ears]”.”° The statement shows a confident attitude 
toward the evidential basis of preventive-hygienic measures in the oper- 
ating room and simple pragmatism with regard to the problem of effec- 
tive headgear. The lack of interest in the question of the right hat in the 
operating room can be better understood by looking at the current posi- 
tions German experts developed and are developing in hospital hygiene. 
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In the German material, the direct references to the question of the cor- 
rect head covering in the operating room can be found in the guidelines 
for hospital and doctors’ office hygiene and the German guidelines for 
perioperative hygiene.” We present these two sources in the following. 

For the new edition of the guidelines for hospital and doctors’ office 
hygiene the hygienist Axel Kramer et al. have introduced supplemen- 
tary chapters on the subject of protective clothing and the updated 
existing ones.’® At the beginning of the section “Personal hygiene of 
nursing and medical staff” (5.2.), the authors state that hygienic mis- 
conduct in hospitals is caused by insufficient knowledge about infec- 
tion transmission. They also recognize that changes in dress code 
always generate debate due to the lack of “epidemiological evidence” 
for wearing professional attire and because clothing is often viewed as 
an expression of personality. This is then followed by a clear position- 
ing on SSI and preventive measures in the perioperative area. According 
to the interdisciplinary group of authors headed by leading hygienists 
in Germany, the hair, ears, sideburns and neck must be covered. They 
cite the AORN guidelines when they state that uncovered hair can 
become a source of SSIs.” The evidence of cross-contamination is not 
questioned and is considered a premise for compliance with the AORN 
guidelines: Kramer et al. write that rationales for wearing occupational 
clothing include the persistence of pathogens on reusable textiles, evi- 
dence of pathogens on occupational clothing and evidence of cross- 
contamination. Accordingly, for the authors, the prerequisites for the 
adherence to the existing regulations include basic knowledge of sepsis 
and antisepsis, of hygiene and infectiology and acknowledging that the 
regulations are based on research and continuously updated. However, 
common sense also plays a role in adherence. A comparison is made 
with an everyday area where hygiene measures to prevent contamina- 
tion are common practice: 


Hair protection is intended to prevent contamination by hair (e.g., 
operating room, kitchen). If splashing of excitable material is to 
be expected, single-use hoods that cover the hair on the head and 
are impermeable to hair should be worn, just as one would when 
performing/just as during activities that pose a risk of infection (e.g., 
large-area dressing changes).50 


By extending the problem of infection prevention in non-high-risk-areas 
(such as in kitchens), the authors suggest comparison with everyday sit- 
uations in which common sense is decisive. In the suggested scenario, 
there is no doubt that workers in the kitchen are obliged to cover their 
heads and that restaurant guests have a right to “hair-free” dishes. 

The German guidelines for perioperative hygiene issued by the work- 
ing group “Hospital and Practice Hygiene” of the Association of the 
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Scientific Medical Societies in Germany (AWMF) exemplify a similar 
attitude and the principle of dual responsibility for protecting both the 
patient and the staff: 


The surgical gown [has] to provide an effective pathogen barrier [...] 
This should prevent the path of infection both from the staff to the 
wound and from the patient to the wound, but not least also from 
the patient to the staff. Head hair protection is worn to reduce the 
risk of contamination of the surgical field by microorganisms orig- 
inating from the hair or scalp of the surgical team. [...] Head hair 
protection must be designed to completely cover the hair of the head 
and beard, if applicable.*! 


What could explain this considerable difference between the discussions 
in Germany and the US? In contrast to the US debate, in which insistence 
on the quality of evidence has played a major role, the group of German 
hygiene experts (and with them the surgical community) has welcomed 
and followed the AORN guidelines. We suggest that this is because in 
the bouffant debate, the EBM ideals of evidence were invoked partially 
as a rhetorical tool. As Trisha Greenhalgh and Jill Russell have argued, 
calls for particular types of evidence can be used as “moves in a rhe- 
torical argumentation game” when conflicts arise in decision-making. ** 
One could propose the hypothesis that the fact that groups of medical 
experts in Germany act as authors of recommendations and guidelines 
on perioperative hygiene increases the acceptance among physicians.° 
Given that in Germany there was no conflict between professional 
groups, there was no need to invoke EBM standards of evidence as a 
weapon in the debate. The German experts on perioperative hygiene 
were thus able to argue on the basis of existing evidence, common sense 
and the duty to protect others and the self. 

The comparison of the US and the German discussions suggests that 
different professional or interprofessional constellations of experts and 
decision makers may influence how claims about evidence and critique 
are formulated. In order to understand and explain acceptance or ques- 
tioning of evidence-based guidelines, it would be important to take a close 
look at such intraprofessional collaborations and tensions in the future. 


Conclusion 


In this chapter, we anatomized a dispute centered on evidential criticism. 
The bouffant debate is an instructive example of how evidence can be 
destabilized in medicine and more broadly. The analysis of epistemic 
and non-epistemic content in the debate has allowed us to examine the 
role of implicit assumptions related to evidence evaluation and applica- 
tion. We have shown how epistemic ideals and non-epistemic concerns 
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influenced the debate about surgical hats and thus also explained how 
it was possible for the AORN and its critics to reach different conclu- 
sions about the same evidence. Through this analysis, we were able to 
pinpoint what understanding of EBM, what ideals of evidence and what 
actual methodological weaknesses moved the critics in their criticisms. 
Finally, we broadened the perspective to include the German context. 
We suggested that the difference between the US and German debates 
indicates that references to the EBM standards of evidence also had a 
rhetorical role in the conflict between the AORN and its critics. Our 
reflection offers a philosophical contribution to elucidating this debate, 
in which clinical, normative and rhetorical elements were intertwined. 

In the bouffant scandal, no one disputed that the risk of infection 
must be minimized in the perioperative area. On the face of it, the debate 
appeared to be about empirical evidence. However, our analysis shows 
that the disagreement actually originates from conflicting epistemic and 
non-epistemic assumptions. The position of the critics of the AORN 
guidelines was based on epistemological assertations typical of EBM, 
namely the demand for correlational evidence and studies focusing on 
clinical outcomes. This gave them reasons to discount the mechanistic 
evidence and the case report that formed the basis of the recommenda- 
tion to cover all hair. In addition to the evidential reasons, the critics 
referred to the financial and environmental concerns in their opposition 
to the new policy. Moreover, in the German context, the same evidence 
rejected by the critics of the AORN in the US has been accepted by the 
hygiene experts and also by the surgical community. That is, the proven 
presence of bacteria on the scalp, hair and ears constitutes sufficient 
evidence that these regions must be effectively covered to form a barrier 
that protects against transmission of pathogens.°* This highlights the 
fact that evidence alone does not help to determine what good practice 
in a particular situation is. 

Philosophy can help us better understand the sources of disagreement 
in science, but how can it help to overcome them? For instance, can 
philosophy offer resources for experts who are in the business of evaluat- 
ing evidence for hygiene guidelines? Philosophers of medicine interested 
in evidence evaluation have suggested new approaches that aim to go 
beyond what EBM offers. For example, more contextual approaches to 
evidence evaluation have been proposed and an evidence-amalgamation 
framework based on Bradford Hill’s work and Bayesian theory have 
been developed.° In their contribution to this book, Fredrik Andersen 
et al. in turn, suggest that the so-called explanatory approach to weigh- 
ing evidence can help expert groups in guideline formulation when 
evidence or the interpretations of evidence are conflicting. These new 
ways of assessing evidence for a particular purpose can provide tools for 
overcoming disagreements in situations where following the EBM ideal 
is practically or ethically difficult. 
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As Trisha Greenhalgh and co-authors argued during the heated dis- 
cussion on the preventive effect of masks in the pandemic, “the search for 
perfect evidence may be the enemy of good policy”.55 A much-discussed 
question in the philosophy of science has been whether delaying an 
intervention until there is so-called higher level evidence is ethically 
acceptable, especially when the suggested measures do not have foresee- 
ably dangerous effects and bring a potential benefit. It has been argued 
that it should be possible to adjust the criteria of evidence according 
to the practical requirements of the situation and the risks involved.87 
Finding the right balance between epistemic ideals, ethical principles 
and practical concerns is thus a challenge that experts applying evidence 
to issuing good policies need to face. Given that there are no established 
guidelines for locating where this balance lies, philosophical reflection 
is needed. 
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6 Negotiating Consensus 
for Diverging Evidence 


An Application of the Explanatory 
Approach to Guidelines for the 
Treatment of Substance Use 
Disorders and Addiction 


Fredrik Andersen,* Yngve Herikstad,* 
Stefan Siitterlin, and Anders Dechsling 


Clinical health practice is increasingly framed within evidence-based 
guidelines, where these guidelines are intended to ensure quality 
treatment based on the best current knowledge of the relevant field. 
Guidelines are intended to ensure that patients receive care reliant on a 
community of specialists rather than decisions made by individual cli- 
nicians. As such, guidelines are meant to harmonize and increase the 
quality of healthcare. Clinical practice guidelines should be regarded as 
“statements that include recommendations intended to optimize patient 
care that are informed by a systematic review of evidence and an assess- 
ment of the benefits and harms of alternative care options”.! Guidelines 
are typically formulated by expert groups who evaluate relevant existing 
evidence and, on the basis of this evidence, suggest treatments. Expert 
group members are selected in a multitude of ways and there is consid- 
erable divergence concerning who is selected. For instance, some expert 
groups consist mainly of methodological specialists who evaluate the 
strengths of conflicting evidence, other expert groups consist mainly 
of clinicians, while others still consist mainly of researchers in relevant 
fields. In effect, differences in ideology, disciplinary background and 
experience are to be expected both within and between groups. 

Expert groups face numerous challenges and it is unclear how one 
should approach guideline formulation.” Evidence relating to the effect 
of specific treatments also often diverges, and thus it is hard to reach 
consensus. Furthermore, as different types of treatment are tested using 
different kinds of methods, the value of evidence is often contested on 
methodological terms. Expert groups, who evaluate already existing evi- 
dence generated by others using multiple methods, must weigh evidence 
and types of evidence against each other, which can be done in multiple 
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ways. All strategies for evidence evaluation can be, and often are, con- 
tested. Ultimately, decisions made by expert groups concerning these 
issues can shape treatment policies for decades and thus radically affect 
the lives of numerous people. It is therefore paramount that guidelines 
are formulated by expert groups in the best available manner. 

We identify four main categories of approaches to weighing evidence: 
Qualitative rule-based techniques, quantitative algorithmic techniques, 
social process techniques and the explanatory approach.? All approaches 
aim to remove threats to the quality of the final decision: Qualitative 
rule-based approaches apply methodological hierarchies in order to 
avoid decisions made from weak evidence. Quantitative algorithmic 
techniques apply algorithms in order to avoid expert biases. Social pro- 
cess techniques collect expert and stakeholder opinions in order to main- 
tain contact with clinical reality and avoid exclusion of key evidence. The 
explanatory approach focuses on how experts explain apparent counter- 
evidence and evaluates explanations in order to exclude ad-hocness. 

The aim of this chapter is to illustrate the benefits of the expla- 
natory approach as compared with social process techniques. As a 
case in point, we will discuss the Norwegian National Guideline for 
the Treatment of Substance Use Disorders and Addiction, currently 
written within a social process, and argue that this guideline would 
benefit from switching to the explanatory approach. We have chosen 
the guideline for the treatment of substance use disorders and addic- 
tion, as this illustrates a wide array of challenges to guideline formu- 
lation. The field is diverse both in terms of clinician background and 
research paradigms. There is wide-spread political debate concerning 
legality, along with scientific debates concerning how various sub- 
stances impact health and society. In addition, as there is a wide array 
of treatment schemes, it is hard to negotiate consensus concerning 
which treatments should be recommended. In combination, the variety 
of choices presented to expert groups constructing guidelines for the 
treatment of substance use disorder and addiction illustrates both the 
complexity and depth required for good guidelines. It is thus an ideal 
arena for testing various approaches. 

In this chapter, we first describe the most common challenges to guideline 
formulation, both epistemic and non-epistemic. After presenting evidence 
evaluation criteria that are suggested in the literature, we give an overview 
of four different approaches to guideline formulation, with an emphasis on 
the explanatory approach. We then introduce the topic of substance use 
disorders and addiction along with the Norwegian National Guideline for 
the Treatment of Substance Use Disorders and Addiction as a case exam- 
ple. Following this, we show how the standard challenges are relevant 
in the specific case, and how the Norwegian National Guideline for the 
Treatment of Substance Use Disorders and Addiction could be improved 
through an application of the explanatory approach. Finally, we argue that 
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the explanatory approach is preferable as a general approach to guide- 
line formulation within the health sciences. 


Challenges to Guideline Formulation 


Guideline formulation faces multiple challenges and demands. For 
instance, there are epistemic challenges relating to how one should 
weigh different evidence. The purpose of guidelines is to provide the 
best treatment available, and in order to decide what the best treatment 
is, one must look at existing evidence. However, different evidence often 
points in divergent directions and expert groups must find ways to single 
out the stronger and more relevant evidence. 

There is an asymmetry between the necessary generalization of scien- 
tific evidence describing groups of individuals and the individual pecu- 
liarities of a single patient. While patients typically have comorbidities 
and individual manifestations of their underlying problem, the general 
evidence provided by science cannot address every possible combina- 
tion of comorbidities and contexts. Since scientific knowledge is general 
rather than universal, clear-cut deductions for specific cases or between 
groups do not exist. 

The scientific focus on the general poses relevance-related questions 
for guidelines. Does the success of a treatment on group A imply the 
future success of that same treatment on group B? Given that the treat- 
ment is effective at group level, how can clinicians be confident that 
their patient is among those who will benefit? These types of translation 
issues are common and lack clear and univocal answers. However, if 
we expect guidelines to be implemented in clinical practice, translation 
issues must somehow be dealt with. 

There is a further challenge in relation to healthcare and general sci- 
entific evidence. While research aims to influence practice, it has been 
argued that there is a lack of effective feedback from practice to research, 
resulting in an inefficient/asymmetric coupling between science and 
practice.* Expert groups should consider how to incorporate data from 
naturalistic settings within the included evidence. 

Expert groups formulating guidelines must also decide how to relate to 
these issues. When facing contradictory evidence, should we rank meth- 
ods, and if so, how should methods be ranked? Should we emphasize 
local evidence, and if so, what constitutes “local” (do we mean gender, 
age, country, culture etc.)? Should we prefer scientific evidence where 
clinician generated data are included? There are no obvious answers to 
these questions and they are therefore settled case by case. 

There are also non-epistemic challenges relating to guidelines. By 
non-epistemic challenges, we include political, ideological, ethical, met- 
aphysical and ontological challenges. For instance, guidelines must con- 
sider not only the potential outcomes of a treatment, but also how that 
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treatment is experienced by the patient, whether the patient must have 
full understanding of the details of the treatment, whether the treatment 
should be mandatory and how much the treatment will cost. In other 
words, guidelines must balance societal needs, ethical issues and politi- 
cal issues along with analyses of expected effectiveness. These judgments 
can be subject to the so-called philosophical BIAS affecting research and 
policy writing. A philosophical BIAS in this sense is a Basic, Implicit, 
Assumption in Science. These are assumptions relating, for instance, 
not only to ethics and politics but also to metaphysical and ontological 
questions such as what we mean by causality, and whether the “entities” 
under scrutiny are best understood as processes, assemblies, capacities, 
powers or substances. The “philosophical BIAS” concept argues that 
these types of assumptions are necessary and irremovable aspects of any 
scientific procedure.® In relation to guidelines, we should expect a vari- 
ety in basic assumptions both within research and within the different 
members of the expert groups. It has been argued, however, that basic 
assumptions of this kind can affect evaluations of policy and guidelines 
as well as basic research.” 

As various authors have emphasized, the distinction between epistemic 
and non-epistemic values is fuzzy at best.’ Epistemic and non-epistemic 
values interact and we should not expect expert groups to construct 
guidelines on a purely evidential basis. Rather, expert group decisions 
will be shaped by experience, ideology and expertise, along with posi- 
tions within ethics, politics and more basic views of reality. A first step in 
the process of domesticating such issues is to make assumptions explicit 
and thus increase transparency. 

So far, we have outlined the common challenges to guideline formu- 
lation. In the next section, we discuss the available tools to overcome 
such challenges, i.e. the available criteria for evaluating evidence and 
approaches to guideline formulation. 


Approaches to Guideline Formulation 


In an attempt to approach challenges systematically, six criteria for eval- 
uating approaches to weighing evidence are presented here.” The stated 
purpose of these criteria is as desiderata against which we can evaluate 
approaches to evidence weighing, and therefore guideline formulation. 
They build on Thomas S. Kuhn’s criteria for a good scientific theory and 
are as follows: Completeness, rigor, scope, transparency, communica- 
bility and practicality. It is to be emphasized that the totality of these 
criteria must consider both democratic and epistemic issues.!0 

The criteria for evaluating processes that lead to guidelines frame 
some of the controversies surrounding guideline formulation for clin- 
ical practice. For instance, we see that criticism of the evidence-based 
medicine (EBM) approach can be formulated as a criticism related to 
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completeness. EBM operates with a clear hierarchy of evidence with sys- 
tematic reviews and randomized controlled trials (RCTs) rated as the 
highest quality evidence. If included, expert opinion is typically placed 
at the bottom level of the hierarchy. Case studies are in between. If an 
expert group has systematic reviews and RCTs available that show no 
evidence for the effectiveness of a particular treatment, the expert group 
is likely to ignore case studies that show effectiveness since case studies 
are of lower epistemic value than systematic reviews and RCTs within 
the EBM approach. In effect, relevant data might be excluded, which 
is in conflict with the completeness criterion. Analyzing approaches to 
guidelines through the criteria presented in the explanatory approach 
provides us with a language and an argumentative base from where we 
can evaluate different strategies.!! 

So how are these criteria met within the most common approaches to 
guideline formulation? We can distinguish four general approaches to 
guideline and policy formulation: Qualitative rule-based approaches, 
quantitative algorithmic techniques, social process approaches and the 
explanatory approach. Each approach is an attempt at balancing threats 
connected to completeness, rigor, scope, transparency, communicability 
and practicality. 

Qualitative rule-based approaches focus on removing expert biases 
while increasing rigor by introducing rules for decision procedures. 
Typically, rules relate directly to evidence weighing. Phenomena for 
which there is contradictory evidence are handled by elevating evidence 
achieved through methods from the top of the hierarchy. Rule-based 
approaches like this are well adapted to limiting variability within a field, 
but face some standard challenges. Contestations of qualitative rule- 
based approaches are most prominently present in the broad criticisms 
of EBM. For instance, it is argued that EBM operates with a narrow 
notion of evidence and that it provides no understanding of causal mech- 
anisms.!? Attempts at reformulations have been made within EBM, such 
as replacing rule following with expert judgment.!5 On a more founda- 
tional issue, approaches like EBM arguably apply the types of judgments 
they were intended to avoid and thus uncritically adopt judgments that 
should be under public scrutiny.'* Here, we wish to emphasize the lack of 
completeness, and the relationship between hypotheses and methods. It 
is a well-established norm within science that methods ought to depend 
on which kind of research question one is asking. However, if we accept 
a strict hierarchy of methods, we end up incentivizing research related to 
certain types of hypotheses. 

If we are interested in helping people with substance use disorders 
and we want to investigate why certain people are susceptible to sub- 
stance use disorders and others less so, we could pose biological, social 
or political hypotheses. These hypotheses might best be investigated 
through different methods. For instance, a biological hypothesis, such 
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as the prominent current notion that substance use disorders are chronic 
brain diseases might best be investigated through mechanistic studies 
on animal models. Mechanisms established in animal models are then 
generalized to humans through functional neuroimaging studies.'5 An 
opposing view, where addiction is viewed as voluntary choice, rather 
than chronic brain disease, is presented in Gene M. Heyman.!* Contrary 
to the mechanistic evidence for addiction as brain disease, Heyman 
presents evidence from addicts’ narratives, psychiatric epidemiology, 
treatment studies and insights from behavioral economics.!” If there is 
empirical support for both hypotheses, and we know the evidential hier- 
archy, we can already predict the outcome of any competition between 
proponents of these two hypotheses. The hypothesis connected to the 
higher ranked methodology wins, and, in effect, we risk “settling” deep 
questions by definition, rather than by increased understanding of the 
phenomena. In other words, hypotheses dictate research methods, and if 
we provide a strict hierarchy of methods, we are already deciding which 
types of hypotheses we are willing to adopt. All in all, qualitative rule- 
based approaches emphasize rigor and methodological transparency at 
the cost of completeness. 

A second approach to guideline formulation is to apply quantitative 
algorithmic techniques, in which the goal is to establish a clear relation- 
ship between hypotheses and evidence without any interference from 
individual experts. Such techniques are intended to avoid subjectivity 
and biases introduced by individual experts.'® We know, however, that 
algorithms also come with biases introduced by whoever is writing 
them.!” These biases will remain invisible to the reader, who is typi- 
cally a non-expert in the quantitative algorithmic techniques involved. 
In effect, quantitative algorithmic approaches emphasize rigor and com- 
pleteness, but tend to lack transparency and communicability. 

Social process approaches “attempt to avoid the problems related to 
the subjectivity of ‘best professional judgement’ of a single expert by 
combining a larger set of expert judgements”.*° The idea behind a social 
process approach is to gather a variety of expert judgments and arrive 
at a preferable position. There are multiple ways to accomplish this. For 
instance, experts can make individual judgments that are later collected 
or be placed together for a debate.*! There are, naturally, many varia- 
tions imaginable for how one would practically perform a social process 
approach to guideline formulation, but the common idea is to avoid 
the weaknesses of algorithmic and rule-based approaches by includ- 
ing expert judgments, and then to avoid the challenges of subjectivity 
directed toward expert judgments by including a wider variety of experts. 

Social process approaches face a particular challenge concerning the 
selection of experts. Algorithmic or rule-based approaches will typically 
reach similar results independent of expert group members, provided 
algorithms and evidential hierarchies are clearly stated. Social process 
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approaches, however, might yield different results depending on which 
experts’ judgments one seeks. Granted, a variety of experts will guaran- 
tee a variety of judgments, but it is by no means clear how to determine 
the degree and kind of variety to be sought. Should we include experts 
on alternative treatments, or should we stay close to the mainstream? 
Should we choose experts who are likely to find agreement, or should 
we choose experts whose ideas differ radically? These are contentious 
questions and, crucially, they are settled before the actual expert group 
is chosen. There is, therefore, a lack of transparency built into the social 
process approach. Even when we have collected an acceptable pool of 
experts, it is not clear how their judgments should be aggregated, if every 
voice should carry equal weight, if consensus is demanded and how to 
treat dissent.”? 

If no consensus is demanded and there are no clear rules concerning 
which types of decisions the expert group should reach, social process 
approaches risk becoming impotent in the sense that expert groups give 
an overview of the field rather than clear decisions concerning what 
the clinical practice should look like. As such, “Rather than serving an 
amalgamating purpose, they are perhaps better suited for an explora- 
tory purpose, to ensure a full range of perspectives are considered”. 
All in all, social process approaches have potential for completeness, 
communicability and practicality, but generally struggle in relation to 
transparency and rigor. 

The explanatory approach starts from the basic premise that scien- 
tists will disagree, and that one central reason for disagreement is that 
different scientists will give different explanations for why the existing 
evidence looks the way it does.‘ In other words, the issue is not so much 
that experts disagree on what the evidence is, or what types of evidence 
are preferable for a given topic but rather that researchers and experts 
have different ways to deal with evidence which appears to oppose their 
view. Reformulating the issue in this way helps us disentangle situations 
where there is disagreement over both specific evidence and standards of 
evidence more generally. The key is to expect evidence contestation and 
disagreement rather than consensus. Contestations and disagreements 
are typically formulated as arguments, and the explanatory approach 
focuses on the quality of these arguments and how they fare in relation 
to standard criteria for scientific explanations. 

With regard to socially relevant issues, it is rarely the case that all 
evidence points in a single direction. However, researchers invested in 
a particular understanding of the world will rarely give up their posi- 
tion unless they have to. A common reaction is therefore to find ways 
to explain why contradictory evidence only appears contradictory, and 
explain this appearance from within one’s preferred understanding.” 
Furthermore, in cases where evidence supports our position, we give 
explanations for why this is so. The explanatory approach starts from 
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how proponents of certain theories explain the appearance of confirm- 
atory and contradictory evidence. The quality of these explanations is 
then rated in order to find the more appropriate one. Theory or treatment 
supported by the more appropriate explanation should be recommended. 
The explanatory approach dictates that we (1) gather all competing expla- 
nations, (2) assess them for adequacy and (3) single out the most adequate 
explanation.?* Pre-clinical studies on mouse models might show that a 
medicine can cause kidney failure, but clinical studies might not confirm 
this finding. A proponent of the idea that the medicine causes kidney fail- 
ure could explain the situation by referring to the experimental set-up of 
the clinical study, for instance that the study did not include participants 
predisposed to kidney failure. A proponent of the idea that the medicine 
does not cause kidney failure might argue that there are deficiencies in the 
pre-clinical studies, for instance that a too high dose or too simple exper- 
imental set-up was used. Both of these explanations are reasonable and 
call for further investigation. If further studies show that one of the 
explanations is inadequate, it ceases to function as an explanation and 
the position fails. In essence, therefore, the explanatory approach is what 
is known as an inference to best explanation approach. The explanatory 
approach applies the following adequacy criteria: Internal consistency, 
empirical competency and predictive potential.*” 

Once the various explanations are tested for adequacy, we can remove 
inadequate explanations and thus reduce the amount of possible posi- 
tions. In this way, we can reduce the number of relevant hypotheses 
and gradually move toward a single recommendation in our guidelines. 
There will, naturally, be cases where the process of selection leads to 
more than one adequate explanation, and thus more than one possible 
treatment. In such cases, we have three main options. We can accept 
a group of adequate treatments and let clinicians choose freely among 
them, introduce further adequacy criteria in order to resolve tie-breaks 
or appeal to institutional responses.25 Whether one ends up in an insti- 
tutional response, introduces further criteria or accepts a group of treat- 
ments as superior, the explanatory approach separates itself from other 
approaches to guidelines by mimicking the scientific process. We can, 
for instance, see that the criteria introduced in the explanatory approach 
are standard criteria for scientific theorizing and debate. Furthermore, 
the role of evidence within the explanatory approach is as premise in 
an overall argument about what the phenomena are, how they should be 
understood and what we should do about them. This is the typical role 
for evidence when we attempt to understand something within science. 

The main cost of applying the explanatory approach is practicality, as 
collecting and analyzing all available explanations is an arduous task. The 
upshot, however, is that the explanatory approach offers potential in terms 
of completeness, transparency, rigor and communicability. We can visu- 
alize the strengths and weaknesses of different approaches in Figure 6.1. 
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Completeness | Rigor Transparency | Communicability | Practicality 


Qualitative X X X Vv Vv 


rule-based 
Quantitative 
algorithmic 


vV vV X X vV 
Social Vv X X Vv Vv 
vV vV vV vV X 


process 
Explanatory 
approach 


Figure 6.1 Categories of approaches/techniques for weighing evidence and 
criteria for evaluation. Table by Fredrik Andersen et al. 


So far, we have discussed challenges to guideline formulations along 
with a set of criteria for evaluating evidence and different approaches in 
light of these criteria. In the following, we present a case example and 
show how the general debate applies to specific cases. We discuss the 
topic of substance use disorders and addiction, and more specifically 
the current Norwegian guideline for the treatment of these issues. The 
focus of our discussion stays on the approaches to guideline formula- 
tions and we avoid discussions concerning which specific treatments 
one should prefer. 


The Norwegian National Guideline for the Treatment 
of Substance Use Disorders and Addiction 


Traditionally, treatment of substance use disorders and addiction has 
relied on charity, religious initiatives and volunteer work. More recently, 
treatment has come under state supervision and regulation. As such, the 
treatment of substance use disorders and addiction is considered part of 
healthcare and is expected to be implemented through evidence-based 
guidelines. However, the issue of substance use in the broad sense is 
more politically controversial than most conditions requiring health- 
care. There are continuous debates concerning the proper legal status 
of substance use and therefore whether substance use disorders should 
be treated within the penal or health system.” Along with debates over 
legality, there are academic discussions concerning which substances 
are more harmful and wider issues relating to social injustice.% Against 
the backdrop of legal, moral and political debates concerning substance 
use, expert groups constructing guidelines for the treatment of substance 
use disorders are under constant scrutiny. 

Formulating guidelines for treatment of substance use disorders and 
addiction presents extra challenges to guideline formulation. Research 
on treatment effectiveness is multidisciplinary in the sense that infor- 
mation about disorders comes from a wide range of fields spanning 
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from psycho-social studies to medical laboratory studies. Additionally, 
clinical treatment is performed by professionals as diverse as nurses, 
social educators, psychologists, psychiatrists, medical doctors and envi- 
ronmental therapists, and treatment is often most effective when inter- 
disciplinary. We therefore have variety both at the level of research and 
clinical practice. On the research end, we face immediate challenges 
concerning, for instance, whether a guideline should focus on specific 
disorder-related outcomes such as abstinence over time, or on more gen- 
eral outcomes such as well-being. There is no clear answer as to which 
type of outcome we should emphasize, and the answer will to some 
extent rely on common non-epistemic assumptions within the expert 
group. Here we see an immediate challenge relating to the completeness 
criterion, as once the focus of the expert group is established, certain 
evidence is already favored. The issue of evidence relevance also stresses 
the need for transparency. A guideline focusing on disorder-specific 
outcomes might, rationally, be ignored by practitioners working toward 
more general outcomes. A guideline can be thought of as a “how to” 
for achieving particular outcomes, and if a clinician is presented with 
a guideline directed at a different outcome, this guideline might simply 
be ignored. 

From a practitioners’ perspective, it is paramount that evaluations 
of relevance are transparent. Otherwise, practitioners with a strong 
belief that a certain treatment is preferable might assume that their 
preferred treatment was never considered by the expert group, and 
thus that the guideline can be ignored. In order for a guideline to 
improve and update actual practice so that patients receive the best 
treatment currently available, it should be transparent to the practi- 
tioner which types of evidence have been considered, and why. Issues 
of practicality will also have an impact on any expert group making 
evaluations concerning which types of evidence and which types of 
treatment they consider. 

The particular multidisciplinarity of practitioners who provide treat- 
ment to persons with substance use disorders and addiction constrains 
the possible ways in which decisions can be communicated. Practitioners 
with varying backgrounds will have varying degrees of training in read- 
ing different types of arguments. This implies that, if one is to com- 
municate guidelines in such a way that they can be implemented, the 
communication must be more broadly accessible than if one was con- 
structing guidelines for an audience with homogenous backgrounds. 

We now examine the Norwegian Guideline for the Treatment of 
Substance Use Disorders and Addiction, determine the approach used 
and suggest improvements in line with the explanatory approach.*! In 
Norway, clinical practice guidelines are systematically developed by the 
public Norwegian Directorate of Health within various fields of profes- 
sional healthcare and treatment. Guidelines are developed as a means to 
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prevent unwanted variation as well as securing quality in various health 
and social services. Clinical practice guidelines have status as national 
guidelines for clinical practice within specific fields in health-care prac- 
tices, providing recommendations that function as treatment standardi- 
zations for a particular population.*? In the treatment and rehabilitation 
of persons with substance use disorders and addiction, several national 
clinical practice guidelines have been developed in the last decade. The 
national clinical guideline of opioid substitution treatment was followed 
by and implemented a national guideline for the assessment, treatment 
and follow-up of people with co-occurring substance abuse and psychi- 
atric disorders.’ Most recently, the Norwegian Directorate of Health 
issued the national clinical guideline for the treatment and rehabilitation 
of substance use disorders and addiction, which is the focus of the pres- 
ent chapter.’* 

With the stated goal of developing evidence-based, recognized, clini- 
cal recommendations for interventions and methods for the rehabilita- 
tion and treatment of various substance use disorders, an expert group 
was established in 2011. The majority of group members (16/19) were 
experts in the field of substance use disorders and addiction. These are 
key professionals and experts holding positions in various public and 
private agencies providing rehabilitation and treatment for persons 
with substance use disorders. In addition, the group consisted of one 
researcher from the Norwegian Institute of Public Health, along with 
two stakeholder representatives. The expert group worked both within 
a plenum and within sub-groups. Initially, sub-groups were divided 
between legal and illegal substances, and later a further division was 
made into groups for coordination, research and external grounding. 
The groups were then joined for 11 common meetings along with three 
meetings with a corresponding expert group in Sweden along with con- 
ferences and study-trips.>° 

The expert group states no hierarchy of evidence, but points out that 
in cases where there is little available research, they have emphasized 
clinical and stakeholder knowledge through internal discussions using 
the international standardized method Grading of Recommendations, 
Assessment, Development and Evaluations (GRADE). The GRADE 
tool is intended to ensure that all relevant issues from cost to feasibility 
and acceptability are considered. There is no stated, overall strategy for 
achieving consensus. The guideline is non-exhaustive, and recommenda- 
tions are presented with various degrees of strength.** Recommendations 
are given within ten overall categories ranging from gender specific care 
and stakeholder inclusion to mapping strategies and levels and intensity 
of treatment. 

Our focus in this chapter is on part four of the guideline, “Therapeutic 
approaches to substance use disorders”, which evaluates 13 therapeu- 
tic approaches. Of the 13 therapeutic approaches, 11 refer to treatment 
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methods, while two recommendations are conditional and thus refer 
to how therapies should be implemented if they are chosen. Of the 
11 treatment methods, two are strongly recommended. These are cogni- 
tive behavioral therapies (CBT) and motivational interviews (MI). The 
remaining nine methods are weakly recommended/suggested.* 

For each recommendation given, the guideline refers to an evidential 
base. Pharmaceutical support for persons with alcohol use disorders 
refers to evidence already graded in England by the National Institute for 
Health and Care Excellence (NICE). In relation to systematic physical 
activity, pharmaceutical support for persons with alcohol use disorders, 
group therapies and couples’ therapies, the expert group has performed 
systematic literature searches. The remaining six recommendations are 
based on the expert group’s clinical knowledge and patient knowledge 
along with discussions with practitioners. These are consensus decisions 
for which the expert group provides a selection of references, but no 
summaries or systematic treatment of the available literature. 

The treatment and evaluation of evidence made within the Norwegian 
Guideline for the Treatment of Substance Use Disorders and Addiction 
illustrates a series of challenges to guideline formulation. In the follow- 
ing, we clarify and discuss these challenges in more detail. 


Challenges and Improvements to the Norwegian National Guideline 
for the Treatment of Substance Use Disorders and Addiction 


The approach applied by the Norwegian expert group is best catego- 
rized as a social process approach to guidelines. The process described 
within the guideline follows Heather E. Douglas’ description fairly accu- 
rately as a group of experts and two stakeholder representatives were 
selected. These are divided into sub-groups focusing on legal and illegal 
substances, research, coordination and external grounding. There are 
no explicit rules for evidence weighing, and no algorithmic techniques 
reported. Furthermore, all recommendations are reported as consensus 
recommendations, either with or without an evidential base, implying 
that the group has reached consensus through debates. These are all 
hallmarks of a social process approach. Furthermore, there is no refer- 
ence to an overall approach to aggregating diverging positions, which 
indicates that no general rule-based approach is followed. 

As we have mentioned, there are some standard challenges connected 
with the social process approach and some of these challenges also apply 
in the case of the Norwegian Guideline for the Treatment of Substance 
Use Disorders and Addiction. The first challenge relates to the choice of 
experts and stakeholder representatives. 

The choice of experts might heavily influence the focus of the expert 
group and it would be beneficial, if a reader was presented with a ration- 
ale for the choice of experts. For instance, why only one researcher 
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and two stakeholder representatives were permanent members of the 
expert group, while the remaining 16 represent the practical field. Of 
the 16 representatives of the practical field, only three are at the level of 
day-to-day contact with patients (two medical doctors and one sub- 
stance use coordinator). Expert groups with a majority of researchers, 
a majority of experts with more direct contact with patients or a major- 
ity of stakeholder representatives are all possible options here, and such 
constellations could have yielded different guidelines. 

The absence of any description relating to how expert group members 
were selected is a threat to transparency. In choosing an expert group, 
one main objective is to ensure that as many treatments as possible are 
considered. This is how social process approaches can avoid individual 
and subjective biases and avoid prematurely excluding possible treat- 
ment candidates. In the current guideline, this is only done to a limited 
extent. Under heading 14.1 “methodological approach” the guideline 
document states that the choices made are non-exhaustively and that 
other possible approaches exist. It goes on to mention contingency 
management, stages of treatment and psychoeducative interventions as 
relevant treatments. The reader is then referred to other guidelines in 
which these treatments are discussed. However, if we follow up and 
read the documentation available in the related guidelines, we find little 
to go on. In the case of stages of treatment, there is a single reference to 
an exploratory paper from 1989.38 In the cases of contingency manage- 
ment and psychoeducative interventions, there is no documentation of 
effect/lack of effect whatsoever. These treatments are simply mentioned 
in passing and excluded from the current guideline. This exclusion 
breaks with the previously established criterion of completeness, and it 
does so without any apparent justification since there is available evi- 
dence to discuss. For instance, in the case of contingency management, 
Danielle R. Davis et al. found 801 reports in relation to substance abuse 
between 2009 and 2014.% Reviews of this kind, along with related 
reports, could have been included within the current guideline. In the 
absence of transparent exclusion rules, the exclusion of this and similar 
evidence appears accidental rather than principled. A further challenge 
relates to how the expert group has reached consensus concerning the 
hierarchy of recommendations. 

In a highly multidisciplinary field, one would expect a divergence 
of initial positions and therefore that there would be a need for a pro- 
cess through which these positions are aggregated. In the Norwegian 
Guideline for the Treatment of Substance Use Disorder and Addiction, 
no such process is presented. This is the case both concerning recommen- 
dations decided on the basis of a collection of evidence and recommen- 
dations that are decided through debate. This is a threat to transparency 
since it is sometimes hard to understand how a strong/weak/no recom- 
mendation was reached. 
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Any clinician who finds a hierarchy of recommended treatments will 
naturally wonder about the basis of the hierarchy. How did the expert 
group arrive at this particular hierarchy? In the case of the Norwegian 
Guideline for the Treatment of Substance Use Disorders and Addiction, 
this is not an easy question to answer. There are three strong recommen- 
dations. However, there is no summarized research base for any of these. 
Neither are there explanations concerning why these recommendations 
are placed at the top of the hierarchy other than a mention of user expe- 
rience, clinical knowledge and expert group consensus. We agree that 
user experience and clinical knowledge are central aspects of the evalu- 
ation of any treatment and assume that this is a position we share with 
most clinicians. However, the guideline provides no description of what 
these user experiences are, and no description of the clinical knowledge. 

As knowledge base, the guideline presents some, although limited, lit- 
erature. For instance, CBT is strongly recommended in the guideline. 
The knowledge base presented for this recommendation consists of the 
following four sources: Christian S. Hendershot et al. provide a sys- 
tematic review of the efficacy of the relapse model for addiction.* This 
review not only shows the relapse model to be effective but also warns 
against confusing terminologies as relapse prevention “has evolved 
into an umbrella term synonymous with most cognitive-behavioral 
skills-based interventions addressing high-risk situations and coping 
responses”.*! Furthermore, Hendershot et al. call for more research con- 
cerning the predictability, scope and applicability of relapse prevention 
methods.* In total, Hendershot et al. put forward a good argument 
for relapse prevention methods while emphasizing the need for a dis- 
tinction between relapse prevention and general cognitive behavioral 
approaches. As such, it is hard to see how their review functions as an 
explanation for the preference for CBT. An explanation of the rationale 
of the expert group on this issue would increase transparency along with 
the efficiency of communication. 

Kathryn R. McHugh et al. conduct a systematic review of cognitive 
behavioral treatments of substance abuse disorders, showing that cognitive 
behavioral treatments are effective.** However, McHugh et al. treat behav- 
ioral and cognitive behavioral treatments as a collective umbrella which 
encompasses MI, contingency management and relapse prevention.* This 
somewhat confuses the taxonomy given in the Norwegian Guideline for 
the Treatment of Substance Use Disorders and Addiction, where CBT is 
treated as distinct from contingency management and MI. Contingency 
management is treated more as an afterthought in the current guideline 
and referred to as a possible treatment along with psychoeducative inter- 
ventions and stages of treatment. MI, on the other hand, is at the top of the 
recommendation hierarchy as a distinct form of treatment along with CBT. 
It is therefore difficult to see how we are to understand McHugh et al. in 
relation to the Norwegian Guideline for the Treatment of Substance Use 


Negotiating Consensus for Diverging Evidence 181 


Disorders and Addiction.*° Here it would be helpful for the reader if the 
expert group had provided explanations for the discrepancies in taxon- 
omy, along with reasons for choosing the current taxonomy, and shown 
how the recommendations are supported by McHugh et al.” 

Hallgeir Brumoen’s book describes itself as predominantly a practical 
treatise, which shows how one can effectively apply behavioral therapeu- 
tic techniques to central elements of substance use disorders.*® Brumoen 
does not provide any basis for comparing behavior analytic approaches 
to other therapies.* 

Nina E. Andresen and Kari Lossius offer a handbook for the treat- 
ment of substance use disorders, which recommends, among other treat- 
ments, CBT, MI and mentalization techniques.50 Andresen and Lossius 
do not advance arguments for comparing strategies but rather show how 
these strategies can be effective and how they should be implemented.°*! 

All in all, the four sources provided in support of CBT are relevant 
and respectable, but it is hard to see how they constitute an evidential 
base for placing CBT at the top of any treatment hierarchy. One issue is 
that McHugh et al. introduce a taxonomy that differs from the taxon- 
omy used in the guideline and subsume mentalization techniques, MI 
and contingency management under the umbrella of CBT.” If we were 
to accept this taxonomy, the guideline actually only strongly recom- 
mends one type of treatment: CBT. However, the guideline document 
apparently does not accept the McHugh et al. taxonomy and treats these 
therapies as separate types of interventions.*? Furthermore, the sepa- 
rate interventions are graded radically differently within the guideline 
document. CBT and MI are recommended, mentalization techniques 
are suggested and contingency management is neither recommended 
nor suggested but rather mentioned as an afterthought in the method- 
ology section of the document. All of this could probably be defended. 
For instance, the guideline authors could argue that McHugh et al.’s 
taxonomy is erroneous, and that there are differences in effect between 
the treatments.5* It could also be argued that CBT and MI are better 
documented and thus more trustworthy as treatments. Another pos- 
sible line of argument would be to refer to existing expertise among 
Norwegian clinicians and claim that CBT is more practical for prag- 
matic reasons. Finally, one could focus on social or cultural differences 
between places where the original research was conducted. All of these 
are potentially reasonable arguments that clinicians could scrutinize, 
contest or be convinced by. However, no such arguments are presented 
in the guideline document, which simply states that the evaluation was 
unanimously decided among the experts. In effect, the entire reasoning 
behind the taxonomy of treatments as well as their prioritization within 
the hierarchy is black boxed. 

A final challenge to the Norwegian Guideline for the Treatment of 
Substance Use Disorder and Addiction concerns its applicability for 
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clinical treatment. The guideline presents a hierarchy of recommenda- 
tions and there are two strongly recommended treatments: CBT and 
MI. As we have seen, MI can also be treated as a subgenre of CBT, 
such as in the McHugh et al. taxonomy.” This implies that one should 
first and foremost attempt to apply CBT. The guideline document also 
mentions relevant treatments that were never considered, such as contin- 
gency management, stages of treatment and psychoeducative therapies. 
This implies that the guideline is non-exhaustive and it is unclear how 
a clinician is to relate to these latter treatments. Can we treat them as 
strongly recommended along with CBT, or are they at a lower level? One 
effect of omitting therapies is that the hierarchy of the guideline is weak- 
ened. The existence of a hierarchy is necessary since a central role of 
the guideline is to set a common standard, to harmonize treatment and 
to avoid unwanted variety. However, if the document does not provide 
arguments for the hierarchy, but rather refers to consensus, and admits 
to omitting relevant treatments, it might ultimately be read more as an 
exploratory document that maps parts of the available treatments. All 
in all, the guideline suffers from challenges in relation to rigor, transpar- 
ency and completeness and in effect faces challenges relating to effective 
communication. 

It is our contention that the challenges presented here can be met, and 
that they have their origin in the type of approach chosen for the expert 
group. As we have seen, the expert group members are experts in the 
relevant field and have extensive knowledge of actual practice. However, 
the expert group was instructed to consider other guidelines, but given 
no particular instructions concerning how to weigh evidence, how to 
aggregate diverging positions and which criteria to apply in cases of dis- 
agreements.°° We suggest that clarifying such issues is central not only 
to the reader, but also to the expert group itself. 

Hitherto, we have discussed general challenges to guideline formula- 
tion, different approaches to meeting these challenges, and illustrated 
these approaches through the example of the Norwegian Guideline 
for the Treatment of Substance Use Disorders and Addiction. In the 
following, we indicate how the guideline could be improved through the 
explanatory approach. 

The explanatory approach applies three main steps: (1) collect the 
widest possible sample of explanations, (2) assess the adequacy of 
the explanations, (3) reduce the number of explanations according to the 
adequacy assessment. The first step might appear counterintuitive given 
that a central purpose of the guideline is to reduce unwanted variety 
and instead set a common standard of treatment. However, if we wish 
to set a common standard, we are obliged to set the best available treat- 
ment as standard. In order to ensure we have the best available treat- 
ment, we fare better by considering the widest possible variety. In this 
way, we avoid accidental omissions. We have seen how the Norwegian 
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Guideline for the Treatment of Substance Use Disorders and Addiction 
has omitted relevant treatments and that one effect of this is that the 
suggested hierarchy is weakened. By applying the explanatory approach, 
and collecting the widest possible variety, this could be avoided and we 
would better satisfy the completeness criterion. 

The second step within the explanatory approach is to assess all 
explanations according to a set of criteria for adequacy. The explanatory 
approach includes criteria of internal consistency, empirical competency 
and predictive potential. A rigorous application of these criteria can be 
presented along with the recommendations hierarchy. In relation to the 
Norwegian Guideline for the Treatment of Substance Use Disorders 
and Addiction, such a presentation would have to include explanations 
for the preferred taxonomy, the relation between available evidence and 
recommendations and the specifics of stakeholder and clinicians’ rele- 
vant experiences. In effect, the reader would know how different treat- 
ments were assessed prior to any hierarchy of recommendations. 

In the final step of an explanatory approach, the expert group 
would present a recommendations hierarchy and thus limit the amount 
of strongly recommended treatments. This is done in the presented 
Norwegian guideline, but within the explanatory approach this hier- 
archy would now be fully transparent as the reader would have already 
been presented with an adequacy assessment. For a field as multidiscipli- 
nary as substance use disorders and addiction, one might expect that the 
adequacy assessment will fail to pick out a single treatment as most ade- 
quate. As mentioned earlier, this could be resolved by either introducing 
further criteria or calling for an institutional response. However, it is 
also possible to maintain a group of strongly recommended treatments 
provided this group is a clear limitation of the original variability. 

In conclusion, it is by no means clear that an explanatory approach 
would yield different recommendations than those already present in the 
current guideline. However, by applying the explanatory approach, we 
could substantially increase the level of completeness, rigor, transpar- 
ency and communicability of the guideline document without seriously 
reducing the practicality of the expert group workload. 


Conclusion 


Treatment for substance abuse and addiction is a notoriously difficult 
field. Treatment aims at different aspects, such as achieving abstinence 
or reduced abuse, to prevent or reduce relapse, in addition to improved 
adaptive functioning.’ Achieving abstinence is considered an ideal out- 
come and is related to better long-term outcomes.** However, if absti- 
nence is one important intended outcome, contemporary treatment must 
be considered less than effective both within Norway and internation- 
ally. Favorable outcomes, such as achieved abstinence, are related to 
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treatment completeness, and in the treatment of substance use dependent 
individuals, drop out from treatment is more common than complete- 
ness.” Seeing how adverse the effects of substance use and addiction can 
be for patients and their families, we are obliged to strive for the best 
possible treatments. Guidelines are, in our view, a welcome contribution 
to boosting quality in this sense. However, guidelines must be compre- 
hensive, transparent and convincing. It is within the nature of scientific 
research that different groups of researchers and clinicians will prefer 
certain treatments over others. When these preferences are not met, con- 
testation of evidence and critical evidence evaluation is to be expected. 
Furthermore, in any scientific field where something of value is at stake, 
we should expect scrutiny and disagreement. If scrutiny, disagreement 
and evidence contestation are treated as integral rather than opposed to 
scientific knowledge, we might better be able to deal with disagreement 
both within science and in science communication directed at the gen- 
eral public. In our view, the expectation that scientific evidence should 
always align often stands in the way of meaningful debates concerning 
reasonable disagreement over evidence as well as policy. We suggest that 
new guidelines treat evidence as premises within arguments and apply 
the explanatory approach to evidence-based guidelines in the future. 

Importantly, our critique is not directed toward the conclusions drawn 
in the guideline. It might well be that CBT is superior as treatment for 
substance use disorders and addiction. Indeed, three of the authors are 
members of the Norwegian Association for Behavior Analysis, and firm 
believers in the effectiveness of behavioral interventions. Our concern is 
with how the guidelines are formulated and the function they are meant 
to have in order to improve the quality of care given to sufferers of sub- 
stance abuse and addiction. 

Finally, we wish to comment on the generalizability of our argument. 
The central aim of this chapter is to show that guideline formulation 
benefits from the explanatory approach. As we have seen, the main chal- 
lenges facing the Norwegian Guideline for the Treatment of Substance 
Use Disorders and Addiction are standard challenges to any social pro- 
cess approach. There will always be possible controversy concerning the 
choice of experts and stakeholder representatives. Furthermore, the social 
process approach struggles with issues of transparency and completeness 
concerning how certain treatments are evaluated and which treatments 
are considered to begin with. The explanatory approach provides solu- 
tions to these issues and, by focusing on explanation and argumentation, 
mimics the scientific process in a way that is familiar to practitioners 
as well as researchers. There is, of course, room for development of the 
explanatory approach as well. For instance, one could argue that there is 
a need for more adequacy criteria or for better solutions in cases where 
multiple treatments appear appropriate. The explanatory approach can 
also be made flexible in the sense that each expert group can formulate 
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context-dependent criteria for adequacy. Still, provided the criteria are 
made public and transparent, we contend that the explanatory approach 
should be the preferred approach to guideline formulation within the 
health sciences. 
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7 Evidence against the “Nuclear State” 


Contesting Technoscience through 
Gegenwissenschaft in the 1970s 
and 1980s 


Stefan Esselborn and Karin Zachmann 


In March 1982, Giinter Altner, a professor of Lutheran theology and 
member of the Enquéte-Kommission zur zukiinftigen Kernenergiepolitik 
(Parliamentary Commission of Enquiry on Future Nuclear Energy 
Policy), witnessed what he described as a scene “fraught with sym- 
bolism” for the further development of science and technology in the 
Federal Republic of Germany (FRG).! During a Commission hearing 
on the potential of catastrophic releases of energy in sodium-cooled fast 
breeder reactors, “a student in sneakers and a so-called leader of German 
science, Federal Cross of Merit in his black-rimmed button hole, faced 
off against each other”. Even more remarkable than the visual contrast, 
Altner thought, was the fact that Richard Donderer, the student who 
had yet to earn his diploma, more than held his own against Heinz 
Maier-Leibnitz, a highly decorated atomic physicist, founding director 
of the country’s first operational research reactor and former head of the 
German Research Foundation (DFG). In fact, the student even seemed 
to have the better technical arguments. To the enthusiastic Altner, this 
exchange foreshadowed the “rise of a new generation” of scientists, and 
even “a new understanding of science and technology” in general.” 
Both Altner and Donderer were leading exponents of a new phenome- 
non in West German science and technology in the late 1970s and early 
1980s, which contemporaries variously referred to as Gegenwissenschaft 
(counter science), Gegenforschung (counter research), kritische or alter- 
native Wissenschaft (critical/alternative science).? These and a number of 
similar terms were employed to describe a rather heterogeneous group of 
actors who set out to contest official academic and corporate science and 
technology —by (mostly) scientific means, but from an explicitly political and 
value-oriented point of view. By the second half of the 1970s, these counter 
experts started to form an increasingly coherent and organized scene, with 
its own independent institutional infrastructure. Despite some resistance 
from established science, leading protagonists of Gegenwissenschaft not 
only quickly became prominent voices in the West German public dis- 
course but also managed to gain entry into the sphere of scientific policy 
consultancy, and ultimately even the private sector consulting economy. 
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In spite of the substantial contemporary attention counter science 
received both in the media and the scientific community, it has so far 
attracted relatively limited scholarly and historical interest. For the case 
of the FRG, only a small number of mostly short sociological accounts 
exist.* This seems all the more surprising as the political and cultural 
history of the West German New Left and the so-called New Social 
Movements in general,’ and of the environmental and anti-nuclear 
movement in particular,’ are by now fairly well known. However, 
the knowledge practices and epistemic basis of these movements have 
only recently become an explicit focus of research, under the umbrella 
term of Gegenwissen (counter knowledge). Within this spectrum, 
Gegenwissenschaft as we define it here can be seen as the most formal- 
ized and systematic part. 

This chapter investigates the emergence and development of West 
German Gegenwissenschaft in the 1970s and 1980s as a case of insti- 
tutionalized contestation of technoscientific evidence practices, with a 
special focus on those actors working on environmental topics, and in 
particular nuclear energy technology.° While counter science - similar to 
the New Social Movements, with which it was closely associated — was 
a thematically extremely broad and heterogeneous field, ranging from 
radical feminism through “Third World” issues to ecological agricul- 
ture, the two above-mentioned issues seem to us of particular relevance 
because of their prominence in the institutionalization and early devel- 
opment of counter science in the FRG. Besides offering a brief historical 
sketch of the field, we are mainly interested in two questions: Firstly, 
what approach did counter scientists take toward technoscientific evi- 
dence practices? Which is to say, to what extent did they attempt to 
challenge not only the prevalent applications and social organization, 
but also the epistemic-methodological basis of science and technology? 
Secondly, what role did Gegenwissenschaft play in the much-discussed 
“crisis of confidence” in science and technology in the 1970s and 1980s?° 
At the time, a number of established scientists and contemporary com- 
mentators tended to see counter science simply as “anti-science”, a dan- 
ger to the authority of scientific knowledge, or even part of a “rising 
flood of irrationality”.!° Contrary to this perception, we argue that at 
least some of the leading protagonists of Gegenwissenschaft saw them- 
selves explicitly as a restabilizing force, who did not want to dispose 
of technoscientific evidence practices but improve them and use them 
for progressive political ends. Instead of a radical alternative to modern 
technoscience, Gegenwissenschaft can therefore better be understood as 
an example of Ulrich Beck’s observation of science’s turn to reflexivity 
in reaction to the advent of the “risk society”. As Beck himself put it, the 
new contestatory movement stood “not in [...] contradiction to moder- 
nity, but is rather an expression of reflexive modernization beyond the 
outlines of industrial society”.!! 
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In trying to answer some of these questions, we start with a brief 
overview of the origins of counter-scientific ideas in the context of 
the alternative movements of the 1970s, pointing out the particularly 
strong connection with the anti-nuclear movement in the West German 
case. Secondly, we survey the institutionalization and structure of 
the field in the late 1970s and early 1980s. We then turn more spe- 
cifically to internal discussions of counter scientists’ self-conception 
and their stance on scientific method and epistemology. Lastly, we 
trace the reactions of the scientific and political establishment, and 
the process of (re-)integration. In doing so, the chapter draws mainly 
on the ample published material produced by protagonists and insti- 
tutions of Gegenwissenschaft themselves, along with coverage of and 
commentary about them in contemporary print media. This empirical 
basis was supplemented by some archival research in German gov- 
ernment archives, as well as a number of oral history interviews with 
some of the protagonists — some publicly available, some conducted 
by ourselves. '2 


Technoscience, Counterculture and the Nuclear Evidence Gap 


Although Gegenwissenschaft was in both form and content in many 
ways specific to the (West) German context, its emergence was also 
part of a larger transnational dynamic, which spawned a number 
of comparable (and often interconnected) movements and initiatives 
in various countries across Europe and North America. Their com- 
mon roots lay in the series of political, economic and cultural shifts 
and fractures confronting Western industrialized societies in the late 
1960s and early 1970s, such as the student revolt of the 1960s and the 
post-materialistic “silent revolution” in societal values,!® the end of 
the postwar economic boom," the discovery of the ecological “limits 
to growth” and the beginning of the modern environmental move- 
ment.!5 After a period of unusually strong faith in science and tech- 
nology, underpinned by the material gains of the “economic miracle” 
and the spectacular successes of Cold War Big Science, the promise of 
unlimited technoscientific progress suddenly seemed to lose some of 
its luster. 

In the United States and Great Britain, it was mainly opposition to the 
Vietnam War and the “military-industrial-academic complex” which 
triggered the formation of the so-called radical science movement, lead- 
ing to the foundation of activist groups such as Science for the People or 
the British Society for Social Responsibility in Science (BSSRS) in the late 
1960s.'!° In the FRG, by contrast, an organized intra-scientific opposition 
was considerably slower to form, particularly in the natural and techni- 
cal sciences. Although the leftist political ideas, the anti-authoritarian 
stance and the new contestatory style of the student movement provided 
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important biographical and intellectual reference points for many later 
counter scientists, the so-called “68ers” did not seem to have much need 
for specialized technoscientific (counter)experts — perhaps because they 
tended to focus more on general societal change than specific technical 
details.” This changed over the course of the 1970s, as the counter- 
cultural scene disintegrated into a kaleidoscope of different alternative 
milieus and protest campaigns. After the failure of the revolutionary 
dreams of 1968, the so-called New Social Movements tried to pursue 
their dreams of an alternative society on a smaller, more practical scale. 
While sharing a similar habitus, language and political outlook, specific 
groups and initiatives usually specialized in one particular issue - such as 
the position of women, environmental degradation, the situation of the 
“Third World”, or the threat of nuclear weapons.'* Since they meant to 
offer detailed criticism, concrete suggestions and practical alternatives, 
acquiring comprehensive and detailed technical knowledge became not 
only a necessity, but also a constitutive practice and a point of pride for 
many of these groups. Unavoidably, this had a significant impact on evi- 
dence practices. As one protagonist later summarized pointedly: “People 
no longer discuss ‘Das Kapital’, but conduct experiments, measure radi- 
ation and construct instruments”.!? 

Although a number of these topics became central concerns of the 
various branches of Gegenwissenschaft, the most important catalyst in 
its institutionalization was arguably the opposition to nuclear energy, 
which grew into one of the largest and most determined alternative 
movements in the FRG in first half of the 1970s. In the heated pub- 
lic debates of the time, the conflict was often presented as a clash of 
fundamentally different worldviews, rather than merely an exchange of 
technical arguments — Robert Jungk’s famous warnings of the coming 
“Nuclear State” being perhaps the most eloquent example.?° However, 
although conflicting normative ideas certainly helped to fuel the con- 
troversy, given the nature of the issues at stake, scientific expertise and 
detailed technical knowledge were also an indispensable resource for 
both sides, if they wanted to be taken seriously in the public discussion.*! 

It was therefore a particular problem for the West German anti- 
nuclear movement that its knowledge base was initially relatively weak. 
Early campaigns mostly originated with local, often rural populations, 
who usually did not have a formal scientific education, or easy access 
to detailed technical information. Although the movement soon drew 
in numerous students and a number of qualified scientists, doctors and 
engineers, most were not specialists on nuclear issues.?? In contrast to 
the situation in the United States, where some of the earliest and most 
important opponents of nuclear energy came from the ranks of nuclear 
scientists and engineers themselves, very few insiders from within the 
German nuclear establishment openly voiced any kind of criticism.2 
Figures like Klaus Traube, a former Interatom manager turned critic 
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after having been targeted by the FRG’s secret service for his leftist 
contacts, were exceedingly rare exceptions.”* While the proponents of 
nuclear energy could count on the full force of institutionalized science 
and technology to support their arguments, German anti-nuclear activ- 
ists either had to rely on the writings of well-known US critics or try to 
use the little information they could glean from their opponents to their 
advantage. 

This “evidence gap” — to use a favorite metaphor of the time — became 
most clearly visible in court.2° According to German law, building and 
operating nuclear power stations required a state license, for which 
the prospective operators had to prove that they had taken the “neces- 
sary precautions” against potential dangers posed by the installation.” 
Because these licenses could be challenged in court, the courtrooms soon 
turned into important battlegrounds in the controversy.*® However, the 
public hearings with large numbers of expert witnesses also vividly illus- 
trated the highly uneven distribution of expertise. For instance, in the 
trial concerning the planned reactor at Wyhl in South-West Germany in 
1977 — arguably the most spectacular of many similar cases - observers 
counted 42 experts supporting the position of the nuclear industry. By 
contrast, the citizens’ initiatives had found only nine “critical” scien- 
tists to testify on behalf of their cause - already including two persons 
specially flown in from the United States.2? Much to the surprise of 
everyone involved, the Freiburg court ultimately still decided in favor 
of the anti-nuclear plaintiffs and revoked the license.*? Nevertheless, 
the experience of the Wyhl trial convinced a number of participants 
that the West German movement urgently needed an institutionalized 
structure to facilitate access to technoscientific expertise and evidence.*! 
In the months following the verdict, a small group around the two attor- 
neys representing the citizens’ initiatives in the case, Siegfried de Witt 
and Rainer Beeretz, therefore started to sound out the possibilities of 
setting up an organization for this purpose, roughly modeled on the US 
National Resources Defense Council (NRDC). On November 5, 1977, 
this resulted in the foundation of the Institut fiir angewandte Okologie 
(Institute for Applied Ecology), or Öko-Institut for short.*? 


From Movement to Institute(s): The Institutionalization 
of Gegenwissenschaft 


As some of its leading exponents later claimed rather self-confidently, 
the creation of the Oko-Institut marked the “birth of ‘alternative’ sci- 
ence” in the FRG. Indeed, although originally intended mainly as a 
counter expertise brokerage service, aiming to “help citizens get sci- 
entific support in court by providing expert opinions and expert wit- 
nesses”,3* the institute quickly grew into the largest, most comprehensive 
and arguably most professional institution in its field - in the words of 
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the environmental historian Jens-Ivo Engels, the “first professional think 
tank of the environmental movement” in Germany.’ Uniquely among 
comparable institutions, the Oko-Institut could draw on a compara- 
tively strong independent financial and organizational base in the form 
of its members, whose number quickly grew to a couple of thousand.3 It 
was led by a ten-member executive board, made up of prominent alter- 
native scientists, environmental activists from the regional and national 
level and representatives of the institute’s employees, while a curatorium 
featuring an all-star cast of West German and international ecological 
activists helped to raise public profile.*” For day-to-day operations, the 
Oko-Institut employed a small administrative staff and a handful of sci- 
entists, supplemented with additional researchers hired on an ad hoc 
basis or working pro bono. With the addition of more commissioned 
project work, the number of permanent personnel increased to around 
20 by the early 1980s — already enough to raise some eyebrows with 
activists steeped in the “small is beautiful” ideals of 1970s countercul- 
ture.3% The project focus and relative independence of the scientific staff 
soon resulted in organizational decentralization. In 1979, branch offices 
opened in Darmstadt, concentrating mainly on nuclear power and its 
risks, and in Hanover, focusing on the conflict surrounding the planned 
nuclear reprocessing facility at nearby Gorleben — the latter breaking 
off as an independent institution in 1981 as Gruppe Okologie (Ecology 
Group, GÖK).>? 

In addition to its role as a broker of counter expertise in court cases, 
the Oko-Institut quickly managed to make a name for itself with a num- 
ber of spectacular counter studies, in the absence of costly laboratory 
equipment often based on a reinterpretation of data gathered by official 
institutions.*0 Publications such as the so-called Energie-Wende (Energy 
Transition) study of 1980, describing a potential energy path for the 
FRG based on renewables and reduced consumption instead of nuclear 
energy, two studies on harmful chemicals in mothers’ milk and drinking 
water in 1981, or a detailed critique of the West German reactor safety 
study published in 1983 created heated public controversies and there- 
fore press coverage.*! In addition, a number of popular-science-style 
publications on topics like household chemicals reached considerable 
audiences and in some cases even made it onto national best seller lists.* 

The creation of the Oko-Institut marked the beginning of a whole 
wave of further foundations of similar grassroots research institutes 
and organizations. By 1980, there were enough of them to form a ded- 
icated umbrella organization, called Arbeitsgemeinschaft ökologischer 
Forschungsinstitute (Ecological Research Institutes Working Group, 
AGOF).*3 In 1981, it already boasted almost 40 member institutions 
from West Germany and neighboring German-speaking areas, cover- 
ing a wide spectrum of topics and approaches.** Closest in form and 
outlook to the Oko-Institut was arguably the Institut fiir Energie- und 
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Umweltforschung (Institute for Research on Energy and the Environment, 
IFEU) Heidelberg, whose origins were also directly related to the 1977 
Wyhl trial. When the Tutorium Umweltschutz (Tutorial Environmental 
Protection), an environmentalist working group at Heidelberg University, 
had provided the plaintiffs with a study attacking official calculations of 
radio-ecological dangers posed by the planned reactor, the University 
tried to shut them down, leading to the reconstitution of the group as 
an independent institute.*° By contrast, the formation of the Katalyse 
Umweltgruppe (Catalysis Environmental Group) in Cologne in 1978 was 
triggered by an article series on water and air pollution appearing in a 
local alternative newspaper. With the revenue from its best selling 1982 
publication, Chemie in Lebensmitteln (Chemicals in Food), the group 
was able to finance its own laboratory, which subsequently became the 
center of its activities.** Chemical and radiological pollution were equally 
the main topics of various groups forming in the orbit of the University 
of Bremen, which thanks to its radical leftist profile had already gar- 
nered a reputation as a “center of academic resistance” against nuclear 
energy in various court cases.* In 1979, two Bremen University working 
groups on nuclear energy and water pollution merged into the Bremer 
Arbeits- und Umweltschutz-Zentrum (Bremen Centre for Occupational 
Safety and Environmental Protection, BAUZ).* Among its rather con- 
troversial cast of members were not only the Bremen physics professors 
Inge Schmitz-Feuerhake and Jens Scheer (the latter a well-known Maoist 
and member of the Communist Party), but also the anti-nuclear activist, 
lay expert and radical right-wing publicist Walter Soyka.* Other top- 
ics of interest to AGOF institutes included ecological agriculture, the 
“Third World”, long-term planning and environmental economics, envi- 
ronmentally friendly architecture and small-scale decentralized “soft” 
technology. The latter two fields were also especially attractive for eco- 
logically oriented engineering firms, which formed a substantial and 
growing subgroup of their own within AGOF.°° 

By the turn of the 1980s, a lively, organized and more or less coher- 
ent field of Gegenwissenschaften had emerged, closely connected to — 
yet also distinct from - the political environmental movement and the 
larger countercultural milieu. It had its own umbrella organizations,’ 
held regular meetings and conferences at places such as the Evangelische 
Akademie Loccum, and published an astonishing amount of material. 
Besides studies, books and pamphlets, various circulars and periodicals, 
such as the Oko-Institut’s Oko-Mitteilungen, the AGOF Rundbriefe 
or the independent alternative quarterly Wechselwirkung, provided a 
forum for internal debates.’ Thematically, the field had branched out 
from its origins in anti-nuclear activism into a variety of topics and 
directions — mostly but not exclusively within the domain of engineering 
and the natural sciences. It comprised a wide variety of actors: Critical 
but established voices within academia, formally qualified scientists 
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and engineers working outside of established institutions, as well as a 
number of political activists, legal professionals and even the occasional 
self-taught lay expert. At the same time, Gegenwissenschaft was deeply 
divided over a number of fundamental questions — including not only 
its stance toward established scientific institutions, but also its under- 
standing of what constituted good scientific method, epistemology and 
evidence practices. 


“Counter Science” or “Anti-Science”? Gegenwissenschaft 
and Its Concept of Science 


The identity questions of Gegenwissenschaft took on a particular sali- 
ence in the early 1980s, when the basic infrastructure was in place and 
the field’s lofty ambitions and ideals started to clash increasingly vis- 
ibly with day-to-day reality. In September 1982, AGOF-researchers 
set up a “self-conception group”, which debated core ideas regarding 
the premises of ecologically oriented science.’ In addition, the Öko- 
Institut devoted a conference in March 1983 to the topic “Ecological 
Research — Between Reality and Utopia”, which was extensively covered 
and debated on the pages of the institute’s journal.>* 

Discussions in both of these contexts dealt notably with the question 
of how to produce good evidence and for whom. The ideas developed 
in the unfolding debate contained evidence criteria for ecologically ori- 
ented research along two dimensions: the social and the epistemic. The 
persuasiveness of knowledge in its social dimension depends on factors 
such as the social trustworthiness of experts, but also the involvement 
of and relevance to citizens who are affected by expert knowledge. In 
contrast, the epistemic dimension of evidence rests on its content-related 
design and its methodological justification. 

As counter-cultural movements had been the midwives for the new 
institutions of counter research, the former’s notions of grassroots 
democracy influenced the latter’s ideas about how to do research in 
order to obtain reliable results. Self-determined agenda setting, non- 
hierarchical structures within the new institutes and cooperation instead 
of competition among the researchers were highly valued ideals within 
AGOF-circles.°5 Not all of these social evidence criteria, however, 
proved easily implementable in practice. In spite of its much-professed 
support for feminist causes, for instance, many Gegenwissenschaft 
institutions tended to reproduce the gender-division of tasks prevalent 
in science and technology at the time.* Another important case in point 
was the strongly emphasized commitment to doing research that served 
the citizens’ initiatives. The alignment with “those directly affected” 
(Betroffene) by technoscientific developments (e.g. the population living 
close to a nuclear power plant) was a widely agreed-on and oft-repeated 
principle.” Whether this commitment also entailed the participation of 
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“ordinary citizens” in the research process itself, however, was a con- 
tested issue.°® One faction insisted on the equality of all forms of know- 
ledge and denied any superiority of scientific knowledge over other 
forms of knowledge such as everyday or experiential knowledge. For 
them, the involvement of “affected” laypersons in research was a ques- 
tion of justice.’ There was, however, more support for the view that the 
best way to serve affected communities was to counsel them and provide 
expert evidence in court, in hearings or similar contexts. 

At the same time, doing research for the citizens (and not with them) 
in specialized institutes was not uncontroversial either. Critics objected 
that this would reproduce the traditional science/society divide, depolit- 
icize Gegenwissenschaft and betray the counter movements. The phys- 
icist and educator Rainer Brämer, for instance, argued that separated 
institutes would “run the danger of appropriation by the ruling sys- 
tem”.°! He already saw the beginnings of an alliance of counter research 
institutions with the ruling circles in state, industry and science, initiated 
by the quest for acceptance and research funds on the part of counter 
science. This alliance, Bramer warned, would “checkmate the inexpert 
citizens’ initiatives by expert alignment” (Expertenabgleich).® Instead, 
Brămer advocated for the political engagement of counter research- 
ers and a relationship of service-oriented subordination to the counter 
movement. For him, the superior evidence value of Gegenwissenschaft 
rested on its partiality for the environmental movement, whereas the 
claim of epistemological and social exclusiveness on the part of estab- 
lished science, which derived from ethical norms such as disinterested- 
ness, demonstrated not superiority, but arrogance and hubris. 

The debate on what the political commitment of counter research 
implied went beyond the social dimension of evidence into the epistemic 
realm. This became obvious in discussions on appropriate forms of 
counter expertise, which crystalized around the question whether coun- 
ter research was to improve established science by the latter’s own means, 
or whether counter research would help to develop new epistemic prac- 
tices and result in a new mode of science. Many actors in the AGOF’s 
orbit - especially engineering consultancies, but also well-known project 
groups within the Oko-Institut, such as the reactor-safety group — took 
pride in working toward the improvement of established science and 
technology. While they rejected the value-neutrality norm of established 
science and technology as a denial of responsibility, they were eager not 
to compromise epistemic standards, but to adhere to them more closely 
than their opponents. In particular, the protagonists of parallel research 
devoted themselves to uncovering flaws and to integrating missing per- 
spectives into mainstream research, but did not intend to abandon the 
established ways of doing science and technology altogether. Instead, 
these counter researchers were anxious to meet the experts from the 
established system as peers and on the same footing.** 


202 Stefan Esselborn and Karin Zachmann 


Those calling for a new mode of science, however, hotly contested this 
position. Peter Pluschke, a chemist and participant in the Oko-Institut’s 
discussion on the reality and ideals of ecological research, accused quan- 
titatively working counter-researchers of an “alternative faith in science”, 
i.e. remaining committed to a simplistic, positivist belief in the authority 
of scientific methods and results. Pluschke attacked trust in numbers, 
linear interpretations and the narrow focus on specific numerical values 
as inadequate. Instead of “counter numbers” and simplistic numerical 
counter evidence, he called for a “more complex scientific understanding 
of the world and a more human-oriented (= nature-oriented) practice of 
research”.® Similarly, the AGOF’s self-conception group argued in its 
final statement in 1983 that in particular the researchers in the field of 
“contesting dead-end technology” (i.e. the part of Gegenwissenschaft 
concerned with criticizing for example nuclear energy) would necessar- 
ily lean too much toward established science and thus adopt the latter’s 
faith in science.‘ 

The theologian and biologist Ginter Altner, one of the founding 
fathers and a leading figure of the Oko-Institute in various positions, self- 
confidently called his vision of a new mode of science Anti- Wissenschaft 
(anti-science) — a term defenders of the status quo liked to employ to 
dismiss critics as irrational and retrograde. For Altner, “anti-science in 
the sense of ecologically oriented research always implies the question 
of justice and of social and ecological compatibility of the knowledge 
increase and the changes it introduces”.° Thus, defining evidence with 
respect to its societally responsible use was one characteristic of Altner’s 
vision. As a second criterion, he considered an alternative mode of cogni- 
tion. According to him, anti-science differed fundamentally from estab- 
lished science in its relationship to nature, since it did not treat nature as 
an object to be exploited, but as a partner to live with. Altner remained 
vague about how such partnership changed the mode of cognition, but 
he felt compelled to add: “Whoever turns away from objectifying science 
does not fall into the realm of irrationality, but needs to try new patterns 
of dialogue and new rules”. He insisted on the need for theoretical 
reflections about how science was to approach nature in an appropri- 
ate way. This would allow gaining a “nature-appropriate knowledge of 
nature” (naturangemessene Naturerkenntnis).% 

How exactly this could be achieved was a core topic in the circles 
of ecologically oriented counter research in general. Many of its actors 
criticized established science for analytical reductionism, narrow 
specialization and a controlling attitude toward nature. Instead of such 
inappropriate ways of examining “external nature”, counter researchers 
shared a commitment to investigate nature in view of its complexity and 
to develop adequate approaches, such as analysis of open systems, con- 
textualization and symbiotic thinking.” A further source of controversy 
was the question whether it was possible to take up these challenges 
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within the institutions of established science. Well-known activists and 
theorists of counter research such as Hartmut Bossel,”! Hariolf Grupp,” 
Gernot Böhme,” Otto Ullrich’ and others saw themselves as critical 
scientists who, nevertheless, trusted in a re-stabilization of the critiqued 
system as source of reliable evidence in the future. Ullrich explicitly 
emphasized that critical scientists opposed the mainstream in their dis- 
cipline, but not as dropouts, as they cherished their acquired knowledge 
and skills.” Many, but not all of these critical scientists had successful 
careers in this very system. 

However, Altner’s vision of anti-science as an alternative mode 
of cognition also left room for a different interpretation. It could be 
read not only as a call for Gegenwissenschaft as a more complete and 
thus “more scientific” form of established science, but also as an invi- 
tation to leave the boundaries of scientific method altogether in favor 
of spiritual, esoteric and similar kinds of knowledge generation. This 
became evident in the contribution of Arnim Bechmann to the Oko- 
Institut’s discussion in early 1983. Bechmann, who was at that time 
spokesperson of the institute’s board, held a chair at TU Berlin in envi- 
ronmental planning, a field that he developed further in his academic 
career as professor and managing director of the institute of landscape 
economics. In 1983, together with Barbel Kraft, who would later defend 
a doctoral thesis on Ecological and Anthroposophical Descriptions of 
Nature, Bechmann criticized ecology as a “legitimation science” and 
called for the inclusion not only of Steiner’s anthroposophy, but also- 
the para-scientific theories of Wilhelm Reich.” He and Kraft faulted 
“academic ecology” for failing to provide explanations for phenomena 
such as “the direction of evolution, the developmental dynamic or the 
behavior of complex systems, the rhythms of natural processes, the prac- 
tical successes of organic dynamic farming, the functioning of divining 
rods etc”.77 Although Bechmann had a successful career in academia 
and supported the environmental movement in very productive ways, for 
example with his engagement for environmental impact assessment, he 
remained actively engaged in the esoteric scene. In 1986, he founded the 
Institut für ökologische Zukunftsperspektiven (Institute for Ecological 
Perspectives of the Future) in Barsinghausen, which offered seminars 
and lectures on “post-materialistic natural science”, including Reich’s 
so-called Orgone theory or the ethereal aspects of plant breeding.”® 

The vast majority of the Gegenwissenschaft community, however, 
rejected the turn to spiritualism and esotericism — although not neces- 
sarily all for the same reasons. Rainer Bramer denounced it as “alter- 
native science on the path to the myths”, with which the researchers in 
his opinion were shirking their political responsibility.”” Others rejected 
both political instrumentalization of science and the call for an alter- 
native epistemology. In a 1983 article, Hansjörg Hemminger, a behav- 
ioral biologist and psychologist, who later became one of the country’s 
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leading experts on pseudoscientific movements, sharply rebuffed any 
thoughts about alternative modes of cognition such as anthroposophy. 
At the same time, he also warned his fellow Oko-Institut members not 
to confuse the epistemic authority of science with political authority, as 
this would result in scientism and render politics impossible. Instead, 
he proposed developing new approaches within established science and 
demanded an alternative research policy with new priorities with regard 
to subjects, sites and applications of research.80 

Thus, the new institutes and actors of counter science did not develop 
a common denominator for their contestation of established science. 
These internal disagreements were not simply academic in nature: How 
Gegenwissenschaft defined itself was not only decisive for the further 
development of the field, but also for its position within the larger scien- 
tific and societal framework in the FRG. 


From Counter Science to Parallel Science: The 
(Re-)Integration of Gegenwissenschaft 


From the point of view of the so-called established West German sci- 
entific community, the emergence of Gegenwissenschaft — whatever its 
exact ideas on scientific method and evidence practices - inevitably con- 
stituted a direct challenge. Unsurprisingly, many scientists and experts 
deeply resented the (at the very least implicit) accusation of being uncrit- 
ical stooges of political and economic interests. Their responses were 
therefore immediate, sharp and not rarely veered into outright personal 
attacks, as many counter scientists complained.*! 

The first and arguably fiercest reactions came from those institu- 
tions which had been the direct targets of Gegenwissenschaft, often 
energetically supported (or even orchestrated) by industry interest 
groups and pro-nuclear politicians. When the Oko-Institut published 
its energy transition study in 1980, for instance, the state-financed 
Kernforschungsanstalt Jiilich (Nuclear Research Institute, KFA) imme- 
diately declared it “unfounded in facts, erroneous in analysis, and 
illusionary in intent”, leading to a prolonged and public exchange of 
arguments and invectives.*? In a hurriedly prepared counter-counter 
study, the Jülich scientists criticized the supposedly selective and manip- 
ulative use of numbers — an accusation that the ecologists themselves 
had regularly aimed at their opponents. While the KFA tried to quib- 
ble with the numerical counter evidence, others resorted to more direct 
tactics. In 1981, a group of municipal water works - having called the 
Öko-Institut’s study on drinking water a “criminal creation of mass 
psychoses by way of pseudo-scientific statements” in their customer 
magazines — had to save themselves from legal trouble by claiming (not 
very plausibly) that their statement had only ever referred to press cov- 
erage of the study.*4 
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By the early 1980s, Gegenwissenschaft had become irritating enough 
for some of the leading exponents of the West German scientific commu- 
nity to take a fundamental stance. During the yearly meeting of the influ- 
ential Max-Planck-Gesellschaft (MPG) in May 1982, MPG-President 
Reimar List indignantly rejected the idea of including “so-called ‘crit- 
ical’ scientists” in the public debate, which in his opinion would only 
serve to needlessly undermine the authority of “truly competent scien- 
tists”.5% Another heavyweight of official German science, Heinz Maier- 
Leibnitz, attempted to solve the problem of expert disagreement once 
and for all with a formalized trustworthiness test. After the encounter 
in the Enquéte-Kommission mentioned at the opening of this chapter, he 
published an article proposing a method to rate the credibility of experts 
based on a randomly selected sample of their statements, without having 
to engage with all of their arguments in detail. Probably not entirely coin- 
cidentally, his test case found Richard Donderer, his sneaker-wearing 
opponent at the Commission hearing, so severely lacking in credibility 
that the finer points of his statements could be safely ignored.$® 

Nevertheless, even in the hard sciences, positivist ideas of scientific 
objectivity and the selfless pursuit of truth were no longer uncontrover- 
sial in the early 1980s. At the same 1982 MPG meeting at which List 
had proudly proclaimed the “value neutrality” of science, none other 
than the federal Minister for Research and Technology, Andreas von 
Bülow, directly contradicted him. According to von Bülow, given the 
“unconcious value system” necessarily underlying all scientific activities, 
value neutrality was an illusion. Therefore, to him, Gegenwissenschaft 
was simply a part of German science - and a useful counterweight 
to those established professors he deemed “too comfortable” to recon- 
sider their own self-conception.* Ensuing discussions on the topic on 
the pages of Bild der Wissenschaft, the FRG’s leading popular science 
magazine, revealed some support for this opinion, particularly among 
younger scientists. The physics professors Harald Fritzsch and Siegfried 
Penselin, for instance, could see no reason to differentiate fundamentally 
between “critical” and “established” scientists, while others, such as the 
biologists Berndt Heydemann and Helmut Zwölfer, even expressed open 
admiration for “those courageous institutes” picking a fight with the 
establishment.°® In a field like ecology, which the German academic sys- 
tem had been very slow to pick up, the environmental economist Udo 
Ernst Simonis claimed, institutions such as the Oko-Institut were even 
ahead of universities and other conventional academic institutions in 
terms of scientific importance. 

Perhaps even more important for the development of Gegenwissenschaft 
than the gradual and often grudging acceptance by German academia 
was the integration into the political expertise system. Despite the often 
confrontational rhetoric on both sides, this process had already begun as 
early as the late 1970s. It was based on a strategic convergence of interests 
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on both sides: On the one hand, groups like Oko-Institut or IFEU had an 
obvious interest not only in making their position heard with those who 
ultimately made the decisions, but also in the financial and symbolic 
resources to be gained by cooperation. Improving the chance for state 
commissions by creating a central point of contact had in fact already 
been one of the main motives behind the founding of AGOF.% By 1982, 
the AGOF was openly embracing its restabilizing function as an argu- 
ment for more public funding. Since the public “no longer trusted the 
industry’s tailor-made research results”, they reasoned, the political fea- 
sibility of any large-scale technical projects would henceforth depend 
on “appropriate counter studies”, which only a strong, independent and 
therefore ideally state-funded Gegenwissenschaft could supply.’ 

On the other hand, given the scale of the public controversy around 
nuclear energy, the administrative and political system was looking for 
ways to calm the waves of the heated public debates by offering some 
form of inclusion and participation. This was especially true for mem- 
bers of the ruling Social Democrat Party (SPD), itself deeply split on 
the nuclear question.” A number of prominent SPD politicians, such as 
Volker Hauff or Rainer Ueberhorst, therefore actively tried to support 
the “scientific wing” of the movement, with which they thought “a con- 
troversial discussion on a high level of expertise” would be possible.? 
As Federal Minister for Research and Technology from 1978 to 1980, 
Hauff used his influence to secure the Oko-Institut its first substantial 
state commission, largely against the resistance of his own subordinates. 
From 1980 to 1983, a group of renegade experts and engineers led by 
Lothar Hahn and Michael Sailer received 1.6 million Deutsche Mark for 
a thoroughgoing critique of the Deutsche Risikostudie Kernkraftwerke 
(DRS), which had itself been one of the Ministry’s flagship projects.?* 
For the Oko-Institut, this was not only a significant financial boost, ena- 
bling it to set up a second office in Darmstadt, but also an important step 
in establishing itself as a bona fide expert institution.” 

For his part, Ueberhorst, the chairman of the Enquéte-Kommission 
zur zukünftigen Kernenergiepolitik from 1979 to 1980, was instrumen- 
tal in the addition of a number of “nuclear skeptics” to this high-profile 
advisory body, among them the Oko-Institut’s Günter Altner.% In its 
concluding report, the commission not only referenced a possible sce- 
nario for a future without nuclear energy directly based on the Institute’s 
“Energy Transition” study but also recommended including skeptics 
in crucial advisory bodies such as the Reactor Safety Commission 
(Reaktorsicherheitskommission, RSK) and the Radiation Safety 
Commission (Strahlenschutzkommission, SSK).?”” Furthermore, the 
Enquéte called for new studies on the risks associated with the German 
breeder reactor project to be done as so-called Parallelforschung (parallel 
research): Two groups of scientists — one “established”, one “skeptical” — 
were to work parallel to each other.” In practice, the experiment did not 
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end well: The two teams — one under the aegis of the semi-governmental 
Society for Reactor Safety (Gesellschaft fiir Reaktorsicherheit, GRS), 
one a specially formed selection of various “critical” scientists, led by 
the physicist Jochen Benecke — never managed to build mutual trust and, 
instead of working together, ended up publicly trading recriminations.?? 

Politically, public commissions for exponents of Gegenwissenschaft 
remained a sensitive issue on both sides. Critics within AGOF worried 
not only that member institutions were about to sell out their indepen- 
dence and become susceptible to pressure from the state. By increas- 
ing professionalization and the necessity to work “with the weapons of 
the enemy”, they feared, the hunt for public funds would lead to a new 
“counter-expertocracy”, a “new discrimination of everyday rationality” 
and a “loss of democratic impetus”.!°° “Will this not serve to refurbish a 
conception of science, whose dismantlement, historically long overdue, 
had just been achieved?” Rainer Brämer asked in Wechselwirkung.'"! 
On the opposite side, objections were expressed no less emphatically. 
Following the Oko-Institut’s first state commission, conservative mem- 
bers of the German parliament positively flooded the government with 
sharply formulated official inquiries concerning the finances of the 
Institute.!% On national television, a CDU-politician declared that it 
was “irresponsible in the times of empty public coffers that opponents of 
nuclear energy, for instance, receive money from taxpayers for scientifi- 
cally untenable studies and agitatory slogans”.!% 

Nevertheless, even the takeover by the Conservatives at the federal 
level in 1982/1983 spelled only a partial and provisional end for the col- 
laboration between political system and alternative institutes. Although 
federal funds dried up for a while, many regional governments contin- 
ued to work with the AGOF institutes. In addition, the rise of the Green 
party — which was elected to the national parliament in 1983 and for 
the first time joined a regional government in Hessen in 1985 - also 
created considerable demand for alternative expertise.!% This demand 
increased exponentially shortly afterwards, when the fall-out of the 
nuclear catastrophe at Chernobyl severely damaged not only the credi- 
bility of West German political authorities, but also of official scientific 
experts and institutions. Geiger counters were sold out for months, as 
many citizens tried to determine for themselves, if their milk was fit to 
drink and their vegetables safe to eat.!°° Old-school anti-nuclear activ- 
ists sometimes deprecatingly referred to the new citizens’ initiatives 
arising out of this as the “Becquerel movement”, thinking them more 
interested in decontextualized measuring of radiation than in princi- 
pled resistance.1% 

However, the established institutions of Gegenwissenschaft likewise 
received a substantial boost to their credibility. As soon as he heard 
of the catastrophe, Hessen’s new Green minister of the environment, 
Joschka Fischer, set up a “standing connection to the Oko-Institut in 
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Darmstadt”, as he was later to claim.!°”? Even the staunchly conserva- 
tive federal Ministry of the Economy now felt the need to commission a 
study on the feasibility of a nuclear phase-out from the Freiburg ecolo- 
gists. As the irate letters to the Minister in the corresponding archival file 
show, this was still a highly controversial proposition. Paying any money 
to the Institute, “Irrespective of the content of the ‘study’”, the highly 
decorated biology professor Hans Mohr fumed, would “make a mock- 
ery of science and a travesty of the principle of scientific expertise”.108 
In his answer, Minister Martin Bangemann emphasized once more the 
function of Gegenwissenschaft in the political process. The Ministry, 
he wrote, had wanted to “demonstrate the attempt to hear as wide as 
possible a spectrum of opinions in this complex and controversial issue”, 
because that was what the German public expected. Of course, this did 
not necessarily mean that the study would have any influence on his 
policy decisions, he quickly added.!% 


Conclusion: Re-Stabilization by Contestation? 


When Ludwig Trepl, himself a veteran of various AGOF institutions, 
tried to take stock of the state of German Gegenwissenschaft in the late 
1980s, he found its development not devoid of a certain irony. In his 
view, in its attempts to harness scientific knowledge, the anti-nuclear 
and environmental movement had ended up creating a “paradoxical 
situation”: “A movement that is genuinely critical of science and in par- 
ticular opposed to the natural sciences [...] not only has a (relatively 
speaking) flourishing scientific branch, but this counter science is mostly 
of just the type that it always criticized: natural science”.1!!0 For Trepl, 
this was a deeply problematic development: If Gegenwissenschaft gave 
up on its ambition to formulate a fundamental critique of traditional sci- 
entific epistemology, he asked, what really was the difference to the kind 
of science practiced at conventional academic institutions — other than 
inferior financial resources, infrastructure and personnel? Did counter 
scientists’ rather narrow orientation toward immediate applicability 
and practical political gains not fall prey to the same misguided logic of 
short-term efficiency and end-justifying-the-means thinking they had set 
out to contest? Was Gegenwissenschaft, as another analysis appearing 
the same year asked pointedly, even still trying to be “an emancipated 
alternative to science”, or had it devolved into a mere “repair shop of 
industrial society” ?!"! 

The further development of the field seemed to confirm some of these 
apprehensions. Over the course of the 1990s, institutions such as Oko- 
Institut or IFEU not only became fully recognized and indispensable 
members of the official expert circles advising administration and leg- 
islation on environmental questions but also increasingly extended a 
hand toward the private economy. With the emergence of corporate 
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responsibility programs and the rise of eco-consultancy as a market, 
counter scientists started to consider themselves less as political activists 
than as purveyors of environmental expertise as a specific commodity.!!? 
Against this background, even a former nemesis like Hoechst AG, one 
of the country’s biggest chemical corporations, could eventually become 
a client.''? On the one hand, this inevitably led to accusations of “selling 
out” and an increasing detachment from the activist base. When Oko- 
Institut’s director, Michael Sailer, publicly criticized activists opposing 
nuclear waste transports in 1996, Giinter Altner and several other 
founders resigned in protest, nearly tearing the institute apart.''* On 
the other hand, integration also offered increased influence and new 
opportunities to introduce environmental perspectives. Particularly 
after the Green party’s ascent to federal political power in the first red- 
green coalition government in 1998, some of the leading exponents of 
Gegenwissenschaft ended up in charge of the established expert organi- 
zations they had started out opposing so vehemently.!!5 

Measured against some of its earliest, most radical ambitions, 
German Gegenwissenschaft — or at least its most institutionalized part — 
can indeed be said to have fallen somewhat short in its contestation of 
technoscientific knowledge production. Epistemically, in spite of many 
heated internal debates, those openly advocating abandonment of ortho- 
dox scientific methods always remained a small minority. In the social 
dimension, while Gegenwissenschaft did in fact open up alternative 
career paths for some experts with only relatively basic formal academic 
qualifications, few counter scientists systematically attempted to involve 
laypersons and ordinary citizens in the production of knowledge.!!6 
Apart from the fact that methodological experiments would have been 
directly counterproductive to the goal of producing evidence that could 
stand in court, in expert committee hearings, or in public discussions 
in the media, most counter scientists — even if they vigorously opposed 
the actual practical conduct of mainstream research and development - 
firmly believed in the basic soundness of scientific methods. By the early 
1980s, at least some of them were not only fully aware of the possi- 
bility that their contestation might contribute to the restabilization of 
the authority of science and technology in the FRG but were actively 
leveraging this position for state support. Ultimately, this pragmatic (if 
sometimes contradictory) attitude toward “the system” was an essential 
factor not only for the institutional success, but also the political effi- 
ciency of Gegenwissenschaft.'” 

In addition to its political importance as an ally of the environmen- 
tal and anti-nuclear movement, Gegenwissenschaft also had a substan- 
tial impact on the history of science and technology in the FRG, which 
has so far been largely overlooked in the literature. This is true in at 
least two different respects: Firstly, even though much of the counter 
scientists’ work was oriented toward relatively limited practical goals, 
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their role in the production of technoscientific knowledge should not 
be underestimated. By engaging in public controversies, by challenging 
research findings, by proposing new approaches and producing empiri- 
cal evidence, they contributed to the development of disciplines such as 
the environmental sciences, risk research or even nuclear engineering. 
Historians of science and technology, used to focusing on state-funded 
universities and Big Science institutions, would therefore do well not to 
forget these alternative spaces of knowledge production. 

Secondly, Gegenwissenschaft can also rightfully claim some impor- 
tant contributions to the general changes in the understanding of science 
and its role in society in the 1970s and 1980s. Counter scientists’ efforts 
to achieve the representation of different political viewpoints in scientific 
expert commissions not only laid the foundations for more integrative 
practices in German science and technology policy; their insistence on 
the political and value-based dimension of scientific evidence practices 
also contributed substantially to the public dismantlement of ideas of 
scientific objectivity and value-neutrality. In this regard, counter sci- 
ence in its various expressions can be seen as a sort of practical political 
counterpart to the more theoretically interested contemporary critiques 
written by scholars from the field of science and technology studies, 
which was emerging around the same time.!! How exactly both inter- 
acted in practice and what influence Gegenwissenschaft had in the larger 
history of reflexive thought on science and technology still remains to be 
more fully investigated. 
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mann, September, 8, 1986. 

BAK B 102-339831, Bangemann to Mohr, October, 16, 1986. 

Trepl, “Was ist alternativ an der alternativen Forschung?” 17. At the time, 
Trepl worked at the IÖW, the result of another break-away of a specialized 
working group from the Öko-Institut. 

Kautenburger, Entstehung, 243. 

Engels, “‘Inkorporierung’ und ‘Normalisierung’”, 96. 

Roose, Made by Oko-Institut, 21-23. 

Roose, Made by Oko-Institut, 23-25. 

For instance, Sailer served as member and at times head of the RSK from 
1999 to 2014 and headed (amongst various other capacities) the FRG’s 
commission on nuclear waste (Entsorgungskommission) since 2011. His 
close collaborator Lothar Hahn, former head of the reactor safety work- 
ing group of Oko-Institut, not only joined him in the RSK but also went 
on to become director of the semi-public GRS from 2002 to 2010. 

This is arguably the biggest difference to Citizen Science projects starting 
in the 1990s, which in some ways can be seen as successors to (at least 
or inspired by) Gegenwissenschaft; see Bruno Strasser, Jerome Baudry, 
Dana Mahr, Gabriela Sanchez, and Elise Tancoigne, “‘Citizen Science’? 
Rethinking Science and Public Participation”, Science and Technology 
Studies 32, no. 2 (2019): 52-76; Andreas Wenninger and Kevin Altmann, 
this volume. 

As Engels, Naturpolitik, 392-399, shows, this highly ambivalent attitude 
toward the state can be seen as a general trait of the West German environ- 
mental movement. While environmentalists often rallied around a rhetoric 
of resistance to a supposedly repressive and “inhuman” state, they also 
confidently expected (and often succeeded in obtaining) its material and 
political support. 

Although both groups shared many similar ideas and often intersected per- 
sonally, the exact nature of their interactions is not yet fully clear. For some 
preliminary thoughts regarding the Anglo-American context, see Schmal- 
zer, Science for the People, esp. 6-11; Peter J. Taylor and Karin Patzke, 
“From Radical Science to STS”, Science as Culture 30, no. 1 (2021): 1-10. 
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8 Appropriating Evidence 


Scientific Criticism and 
Environmental Activism in the 


Global Pesticide Controversy 
during the 1970s and 1980s 


Sarah Ehlers 


We urgently need an end to these false assurances, to the sugar coat- 
ing of unpalatable facts. It is the public that is being asked to assume 
the risks that the insect controllers calculate. The public must decide 
whether it wishes to continue on the present road, and it can do so only 
when in full possession of the facts. 

Rachel Carson, Silent Spring, 1962.! 


In 1962, Rachel Carson’s Silent Spring brought environmental concerns 
about the dangers of synthetic pesticide use to the American public. 
Often credited with starting an environmental movement, Silent Spring 
led to a decade of fierce political conflict and intense scientific research 
on the hazards of pesticide use, which eventually spurred a reversal in 
the United States’ national pesticide policy. It took a full decade before, 
in 1972, the newly founded US Environmental Protection Agency (EPA) 
banned DDT for virtually all but emergency uses in the United States 
because of its persistence in the environment and accumulation in the 
food chain. By 1974, most industrial countries had followed suit and 
banned many persistent pesticides.? The pesticide industry, however, 
continued its growth. Shifting their sales of persistent pesticides to the 
developing world, chemical companies even boosted their output after 
the publication of Silent Spring. By the mid-1970s, the debate about haz- 
ardous pesticide use had also shifted, alerting the public to the pesticide 
problem in the poor countries of the South. When the social and ecolog- 
ical conditions in many parts of Latin America, Sub-Saharan Africa and 
South Asia magnified the ill effects of hazardous substances, pesticide 
use in the developing world became a matter of contention.? As Rachel 
Carson had done in 1962, scientists, journalists and activists researched 
and published about the risks of persistent pesticides, now in the context 
of developing countries, and urged the public to consider “the facts”. 

In this chapter, I will examine the variety and competition of forms of 
knowledge about pesticide use in the Global South during the 1970s and 
1980s. Drawing on anti-pesticide material such as activists’ publications 
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and pamphlets as well as journalistic documents and documentaries, 
I will outline strategies to raise awareness on environmental destruction 
and health hazards in developing countries. Thereby, this chapter gives 
an account of how contestations of evidence shaped a controversy that 
was both academic and political in nature. Evidence, philosopher of sci- 
ence Nancy Cartwright reminds us, is never an abstract phenomenon: 
“What a claim means in the context in which it is first justified may 
be very different from what it means in the different contexts in which 
it will be put to use”.* Against the backdrop of the increasing use of 
scientific knowledge as a legitimatory resource in political discourse, it 
traces the development of evidence criticism and its political implications 
in the debate on global pesticide use. This has important implications 
for negotiating social consensus today: Studying how critics made use 
of different forms of evidence will help, I argue, to understand not only 
the role of expertise in political conflicts, but also the contingent and 
dynamic nature of evidence in modern knowledge societies.’ 

To this end, I firstly discuss how a pesticide export industry developed 
after the ban of DDT and other persistent pesticides in industrial coun- 
tries. Since the most lucrative market for pesticides was in agriculture 
and, in particular, in the application for crops to be exported to the US 
and Europe, debating pesticide use in the South became a matter of envi- 
ronmentalism as well as consumerism. While scientists studied the many 
effects of pesticide use, activists and newly founded transnational initi- 
atives denounced the export of banned substances to the “third world”, 
calling attention to their immediate environmental and health impacts. 
Secondly, I explore how already precarious environmental knowledge 
claims were particularly contested in the Global South. How, given this 
context, could environmental criticism become a destabilizing factor in 
established risk assessments? Exploring the link between North-South 
solidarity and fears about food security, I outline new strategies devel- 
oped by organizations concerned about environmental destruction. 
Thirdly, my chapter will focus specifically on the evidence these activ- 
ists produced: The way they presented and published scientific results, 
images or voices from the South, and the ways they countered evidence 
for pesticide use by the chemical industries. Illuminating how activ- 
ist groups expanded their work beyond national borders to challenge 
multinational corporations, this chapter emphasizes the tension-laden 
relationship between global entanglement and environmental regulation 
differences during the 1970s and 1980s. 


Going South: Pesticide Export after Silent Spring 


Although the EPA hearings had exposed the long-range risks in the 
continued use of DDT to the public, and most developed countries had 
banned DDT’s and other persistent organic pollutants’ agricultural use 
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during the 1970s, they still allowed for its continued manufacture and 
export. This inconsistency created a paradoxical set of issues that not 
only complicated the application of environmental regulation for the 
Western chemical industries. It also posed a moral challenge for devel- 
opment policy. International development aid and the WHO’s disease 
control programs continued to rely heavily on the use of DDT and other 
hazardous substances in the Global South. While there was some justi- 
fication for this, mainly in the control of Malaria and other insect-borne 
diseases, disease vector control was only a small fraction of the pesti- 
cide export. Most of the exported pesticides were used in agriculture. 
More importantly, a rapid increase in observed insecticide resistance 
created doubts about the overall usefulness of DDT and other organo- 
chlorides even in disease control.’ Yet, in spite of openly debated health 
and environmental risks, pesticide use in developing countries climbed 
23 percent between 1971 and 1973.8 Moreover, despite these numbers, 
the pre-dominantly right-wing myth that the DDT ban undermined 
programs against malaria around the world and therefore condemned 
millions of people to death from the tropical disease gained popularity 
and continues to re-surface in political debate until today.’ 

For the pesticide industry, the process of finding new pesticides was 
tedious and costly. Instead, many companies looked south for expansion. 
Clearly, it was only because of exports that the period of pronounced 
growth in pesticide sales continued during the 1970s. Sales dropped 
briefly during the early 1980s but then began to increase again.! From 
1972 to 1985, imports of pesticides increased by 261 percent in Asia, 
95 percent in Africa and 48 percent in South America.!! Especially in the 
poorer markets, companies frequently marketed older pesticides, which 
were broader in spectrum and cheaper.!? Conversely, for importing 
nations, deploying these pesticides for crop production not only meant 
a fundamental shift in how they produced food and fiber crops, it also 
created enormous health risks, in particular for farm workers handling 
the pesticides. While the long-term consequences for human health and 
the environment are still not fully known, in the years to come, the direct 
human health impacts of the explosion of the global pesticide market 
would become apparent in the rising number of pesticide poisonings.'? 
In 1972, the WHO estimated there were approximately 500,000 cases of 
accidental pesticide poisoning, and by 1987, the estimates had risen to a 
million victims per year." Still, the number of unreported cases exceeded 
the number of reported cases. Reporting for the New York Times in 1977, 
Alan Riding interviewed a nurse at a local clinic in Guatemala. Treating 
about 30 or 40 people a day for pesticide poisoning, she explained: “The 
farmers often tell the peasants to give another reason for their sickness, 
but you can smell the pesticide in their clothes”.!5 

During the 1970s, pesticide harms abroad became a matter of public 
interest. Following the UN Stockholm Conference in 1972, which had 
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signaled the rapid broadening of the environmental movement, NGOs 
and activists campaigned for reforming development policies to incor- 
porate ecological considerations. Whereas development and environ- 
ment were no longer seen as incompatible, the conference exposed the 
challenges of seeking national solutions for global problems as well as 
bringing together economic growth with ecological concerns.!* The new 
environmental slogan, “sustainable development”, also revealed pesti- 
cide use in a different light. Compared to the debates following Silent 
Spring, weighing the pros and cons seemed even more complicated. As 
deeply embedded in global economy as in development policy and in the 
environment, debating pesticide use wove together a wide range of top- 
ics. Therefore, presenting a comprehensive look at the export of banned 
substances and its direct and long-term consequences for the public cre- 
ated a challenge for activists, journalists and policymakers alike. High 
profile western media organizations, such as the New York Times, PBS 
and the Center for Investigative Reporting, published award-winning 
material on global pesticide issues.!7 Yet, despite garnering considerable 
public attention, exporting banned hazardous pesticides continued to 
be legal. Neither national nor international environmental or foreign 
trade legislation prevented the widespread environmental contamination 
and the documented poisoning of people. 


Challenges of Environmental Knowledge 


Although DDT and other hazardous pesticide use was a much-debated 
issue during the 1970s, for environmental activists, calling out the 
global pesticide market created a double challenge. Firstly, this was due 
to the epistemic specificities of environmental knowledge, in the words 
of historian of science Dominique Pestre, “a weaker form of knowl- 
edge”.!5 Secondly, arguments against pesticide use tended to appear 
negligible compared to those for economic growth or agricultural pro- 
duction, notably in the poor countries of the South. Generally, evidence 
for environmental destruction and claims about environmental hazards 
are complicated to put forward. Documenting effects from chemical 
exposure, pollution or radiation is difficult as it takes place gradually 
and often invisibly. For example, a 1987 scientific publication called the 
effects of hazardous chemicals in the developing world “Bhopal in Slow 
Motion”, referring to the 1984 industrial disaster at the Union Carbide 
India Limited (UCIL) pesticide plant in Bhopal, India.'? Describing the 
strategic and representational challenges posed by this kind of ecological 
degradation, environmental scholar Rob Nixon coined the term “slow 
violence”: “Falling bodies, burning towers, exploding heads, avalanches, 
volcanoes, and tsunamis have a visceral, eye-catching and page-turning 
power that tales of slow violence, unfolding over years, decades, even 
centuries, cannot match”.20 Moreover, scientifically, “the environment” 
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is extremely complex as an object of inquiry and implies a large variety 
of studies, tools and techniques. Environmental sciences therefore only 
exist as an interdisciplinary academic field, and as such, it mobilizes a 
set of studies and tools that are not hierarchized and produces data that 
is varied in nature and complicated to assemble and to assess.?! Both 
in the eyes of specialized literature as in the popular imagination, the 
heterogeneous nature of environmental science therefore produces seem- 
ingly inconsistent and less convincing results — especially compared to 
disciplines such as physics, biology or chemistry.* 

In the pesticide controversy, disciplinary and epistemic differences 
meant that science and scientific evidence appeared to some actors to 
have been weaponized for political ends rather than relating to objec- 
tive realities.” Drawing on ecology, biochemistry, agronomy, toxicology 
and many more disciplines, both proponents and critics of pesticides 
sustained their claims with results from a broad range of scientific stud- 
ies. For non-experts, the debate touched off by Silent Spring increas- 
ingly brought to light the inconsistencies and contradictory nature of the 
scientific discourse on pesticide risks. Scientific authority was at center 
stage early on when, for example, some scientists called Rachel Carson’s 
work “unscientific” or “overwrought” because Silent Spring also 
included emphatic ethical statements and arguments.” In a similar vein, 
in 1971, DDT proponent Thomas Jukes claimed in a letter to the New 
York Times: “If the environmentalists win on DDT, they will achieve, 
and probably retain in other environmental issues, a level of authority 
they have never had before. In a sense then, much more is at stake than 
DDT”.>5 After the ban in industrial countries, the controversy developed 
into a struggle over the benefit-cost ratio of hazardous pesticides in the 
developing world. While proponents declared that pesticides saved lives, 
critics argued that they produced unwarranted environmental, economic 
and social catastrophes in the South.26 

For pesticide critics, claims of validity, especially concerning long-term 
health costs, were hard to establish. In 1978, the New York Times quoted 
Dr. Samuel S. Epstein on the health harms of pesticide use: “It’s compara- 
ble to the relationship between cigarette smoking and lung cancer—it took 
20 years to prove”.?’ Over the course of the debate, each side even advanced 
their views about technology and ecology. Scientific disputes on biodiver- 
sity, toxic residues and carcinogenics became battlegrounds in the broader 
collision of environmental ethics and human ethics.2% For the public, the 
distinction between the two could be hard to discern. Hence, instead of 
negotiating consensus, competing forms of knowledge - including politi- 
cal and moral judgments as well as internal scientific differences — were a 
main driver for the divisiveness of these debates. 

Generally, evidence for environmental destruction depends on the 
political, social or institutional space in which debates take place. The 
pesticide debates during the 1970s unfolded when norms, regulations 


Appropriating Evidence 229 


and economic instruments were seen to be the solutions of choice and 
economists as the ultimate experts on environmental protection.?? Yet, 
being too complex for a so-called scientific or technological fix, the global 
pesticide problem did not fit into any of the existing categories.°° This 
was particularly relevant for the dominant policy tool of cost-benefit 
analyses. Although often depicted as neutral or scientific, cost-benefit 
analyses structurally optimized quantifiable material benefits while the 
number and design of their parameters was prone to manipulation.*! 
Moreover, proposed solutions to environmental hazards were heavily 
susceptible to political and economic interests. In 1971, the Programme 
of Work for the OECD made this abundantly clear, stating “governmen- 
tal interest in maintaining an acceptable human environment must now 
be developed in the framework of economic growth”.*? This way of han- 
dling environmental challenges put the pesticide industry in a position of 
power. While monetary policies that encouraged cash crops for exports 
increased pesticide sales, only a small number of transnational corpora- 
tions dominated the market.” Given the dogma that population explo- 
sion, poverty and hunger had created the need for production increases, 
which only pesticides could deliver, the pesticide industry was seen as 
essential to development policy. Yet despite this setting of structurally 
“weak” environmental knowledge and strong economic interests, pro- 
fessionalized organizations became a critical part of activism and suc- 
cessfully confronted corporate power. 


Breaking the Circle of Poison: North-South Solidarity and 
Global Activism 


Breaking the “circle of poison” became a slogan for the environmentalist 
movement after the publication of David Weir’s and Mark Schapiro’s 
Circle of Poison: Pesticides and People in a Hungry World in 1981. With 
their investigative study, the two journalists demonstrated how chemi- 
cals banned in the United States would return through food imports.3* 
Powerfully written, Weir and Schapiro’s circle not only linked the Global 
North and the Global South through pointing to the chemical industry’s 
profits but also through a notion of shared victimhood: 


Every minute, someone in the Third World becomes a victim of 
pesticide poisoning. And we are victims too. Illegal levels of pesti- 
cides turn up in ten percent of the food shipments that arrive at our 
borders; yet many of these contaminated foods still reach supermar- 
ket shelves, completing the circle.*5 


Rife with tables, graphs and statistics, Circle of Poison made plenty of 
use of scientific studies. At least 25 percent of US pesticide exports, they 
stated, were products that were banned, heavily restricted or have never 
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been registered for use in the United States. As a result, about ten per- 
cent of the food items imported into the United States contained higher 
levels of pesticides than permitted. For instance, almost 50 percent of 
the coffee beans imported to the US showed traces of banned pesticides 
such as DDT or Dieldrin. In developing countries, the amount of toxic 
residues was even more alarming: For example, the average DDT lev- 
els in cow’s milk in Guatemala were 90 times as high as allowed in 
the United States. People in Nicaragua and Guatemala carried 31 times 
more DDT in their blood than people in the United States. Combining 
numbers with personal stories and engaging images, the authors exposed 
the nexus between pesticide exports, food production and public health 
to the American public. In the wake of its publication, documentaries 
and publications such as “Pesticides: For Export only” or “The Pesticide 
Boomerang” took up the issue.?° Moreover, during the 1990s, a “Circle 
of Poison Bill” was introduced repeatedly to the American legislation, 
but failed every time.37 

While the Circle of Poison argued that this regulatory loophole of pes- 
ticide export had been a disaster both for industrial countries and for the 
developing world, it stated clearly that the impact was far worse for the 
poor countries in the South. Yet in response to being unequally affected, 
Weir and Schapiro asked for global solidarity and activism. In order 
to break the circle of poison, North and South had to work together, 
they argued: “We must begin to see third world people not as a burden 
or a threat, but as allies”.38 Indeed, their urge to control the export of 
hazardous substances was backed up by a chorus of voices from the devel- 
oping world. In 1977, for example, Dr. J.C. Kiano, the Kenyan Minister 
for Water Development, demanded at a meeting of United Nations 
Environment Programme (UNEP) that “unless a product has been ade- 
quately tested, certified, and widely used in the countries of origin, it 
should not be used for export”.*? In 1978, the Central American Non- 
Governmental Conservation Societies Conference adopted a resolution 
demanding President Carter “extend this protection [the ban of hazard- 
ous pesticides] to the rest of the humans of our planet”.* Frequently 
quoted in Western activist publications, statements like these debunked 
the claim that poor countries would welcome imports of banned pesti- 
cides or not care about the consequences. 

Responding to global corporate power with global activism was also 
the guiding principle of the Pesticide Action Network (PAN). Founded 
in 1982 at a meeting in Malaysia by activists from around the world, the 
network was planned as an international coalition of NGOs, scientists 
and activists, many of them in the Global South. In 1984, they went pub- 
lic with the so-called dirty dozen campaign as an attempt to ban certain 
pesticides not only in the North, but worldwide.*! Confidence in their 
ability to change global politics was crucial for this new movement.? 
When, for example, Anwar Fazal, one of their founding members, was 
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asked in an interview about the power relationship between multina- 
tional corporations and activist groups in the years to come, he declared 
boldly, “there will be major changes in the pesticide industry. They have 
no choice”. Activists saw the reason for this global power of pesti- 
cide criticism in the newfound global public. The way that Silent Spring 
had galvanized the American public into an awareness of the dangers of 
hazardous chemicals had to be translated to a global level. If industries 
were acting across borders, Fazal declared, so was environmental criti- 
cism: “We have now got muscle globally to deal with them in a way that 
we never had before: power to organize globally, to organize boycotts, 
direct actions, shareholder actions, power to embarrass them for engag- 
ing in unconscionable activities”.** 


Evidencing Pesticide Criticism 


Although the pesticide controversy centered on facts about the risks and 
benefits of hazardous substances, self-produced scientific knowledge 
only played a minor role. Instead, most of the pesticide criticism during 
the 1970s and 1980s relied on data from secondary sources. Compared 
to other alternative movements from the 1960s onward that produced 
critical and alternative forms of knowledge at the intersection of aca- 
demia and activism, in particular the campaign against nuclear energy, 
structures of knowledge production against hazardous pesticide use were 
less institutionalized and less well funded.* Only rarely did pesticide 
critics themselves measure, for example, the extent of water pollution 
or soil contamination. In activists’ publications, references to smaller 
self-funded research projects or scientific investigations into the pesticide 
problem sponsored by NGOs such as Oxfam were the exception rather 
than the rule.* Instead, statistics, tables, diagrams and calculations 
from government agencies or international organizations were quoted 
and referenced in numerous publications. While some of the institutions 
were newly founded in order to deal with environmental challenges, 
such as the US Environmental Protection Agency (EPA, 1970) or the 
United Nations Environment Programme (UNEP, 1972), institutions 
such as the FAO, the WHO and the OECD also increasingly devoted 
their attention to environmental issues and published extensively on pes- 
ticide issues. Compared to their efforts, activists simply did not have 
enough resources to produce the data necessary to support their claims.* 
Additionally, especially for data on pesticide exports, publications by 
the chemical industries themselves were an often-referenced source for 
pesticide criticism. For pesticide activists, producing knowledge mostly 
meant compiling, commenting, interpreting and editing externally 
obtained scientific results; ironically, often produced by institutions that 
were the very targets of their protest. In this regard, pesticide activism 
during the 1970s and 1980s was less about questioning scientific results 
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or official findings, than about negotiating their consequences, and ulti- 
mately, about the position of environmental knowledge. Activists would 
publish findings produced by government agencies in order to demand 
that their respective governments take these findings seriously. 

In particular, with regard to publications by the chemical industries, 
turning external sources into evidence against pesticides also implied 
reading them against the grain. For instance, the German branch of the 
Pesticide Action Network stated “we are not aiming at new calcula- 
tions on pesticide effects [...] Rather, we will analyze their [IPS, Industry 
Association for Crop Protection] data and dissect it with our questions”.*8 
The chemical industries responded to this activist criticism by turning 
the accusation around: “Critical publications on this topic use the wrong 
data, or: use data wrongly”.* Indeed, much of the pesticide controversy 
was about how to interpret data on pesticide use and crop productivity 
correctly. Many publications from the 1970s and 1980s attacked the 
pesticide lobby for spreading misinformation by publishing misleading 
data and comparisons.” Environmental campaigner Jürgen Knirsch, 
for example, accused the German industry association of “number- 
juggling” for repeatedly disguising the difference between quantitative 
and monetary consumption figures. Their comparison between the mon- 
etary consumption of pesticides in industrial and developing countries 
was all but useless, he argued, as long as they were referring to different 
pesticides. A volume of 33 kilograms DDT, for example, cost the same 
as one kilogram of the insecticide Cypermethrin, which was newer and 
safer and - unlike DDT - used in industrialized countries.*! In a similar 
vein, Oxfam author and campaigner David Bull criticized the company 
Velsicol for advertising their product Chlordane as “comparatively [...] 
the safest insecticide”: In fact, he stated, Chlordane’s toxicity was com- 
parable to the highly toxic chemicals Heptachlor, Aldrin and Dieldrin, 
which were banned for almost all uses in the US and Europe.*? 

In addition to critically commenting on published evidence on pesticide 
use, environmental critics called for new factors to be included in calcu- 
lating risks and safety. Being specific to the application of pesticides in 
the Global South, many factors did not feature in the political economy 
of environmental questions. Yet, critics argued, they were at the heart 
of the global pesticide problem. In many ways, dangerous accidents and 
intoxications were caused by a lack of safety precautions. Pesticides in 
the developing world were often used without any protective gear, such 
as boots, coveralls, respirators, chemical-resistant gloves and aprons and 
protective eyewear. To illustrate, many activists’ publications on pesti- 
cides in the developing world included picture material of farm workers 
handling dangerous substances wearing only light clothing such as shorts 
and a T-Shirt (See Figure 8.1).5 Besides the lack of protective equipment, 
most agricultural use of pesticides in the South also lacked appropriate 
information material. Poor literacy in most developing countries made 
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Figure 8.1 Book Cover, David Bull, A Growing Problem: Pesticides and the 
Third World Poor (Oxford: OXFAM, 1982), reproduced with the 
permission of Oxfam, www.oxfam.org.uk.s? 
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it impossible to read or follow complex label instructions. Moreover, 
activists frequently pointed out that hazardous chemicals were sold 
without any warning or application manuals. As a result, pesticide han- 
dlers would simply not know how to follow safety precautions and, for 
example, not to smoke or chew while spraying or what to do in case of 
skin or eye contact.°+ However, even if workers knew about the dangers, 
they were in a structurally weak position. Journalists Shapiro and Weir 
called attention to the socioeconomic context of pesticide export by ask- 
ing rhetorically: “Can pesticides — poisons, by definition — be used safely 
in societies where workers have no right to organize, no right to strike, 
no right to refuse to carry the pesticides into the fields”?5° Given the lack 
of any potent government agency overseeing regulation, the strikingly 
obvious consequence of pesticide use in poor countries was a complete 
lack of safety procedures. 

Apart from their nefarious role as a hazard factor in the Global South, 
critics also highlighted the use of highly potent pesticides. Being cheap 
and easily available, pesticides often replaced other chemical substances 
in the home or in medical applications. For instance, agricultural pesti- 
cides were often used for treating head lice, on parasites on domestic ani- 
mals, or termites and other insects in houses, for food preservation and 
fishing.°° In a collection of statements from German development aid 
workers published by the German section of PAN, a Niger-based official 
reported that after a pestbird control spraying campaign killing over 
50,000 songbirds, the local population would collect the dead birds in 
order to eat them. Sold by untrained dealers, different pesticides were 
frequently mixed together to make them more effective. “One wonders 
if people really do not know what they are doing”, PAN quoted a devel- 
opment worker from the Ivory Coast.’ Combined with a lack of medical 
facilities, antidotes and poison treatment centers, as well as the confu- 
sion of symptoms of pesticide poisoning with common illness, the wrong 
application and inappropriate mixing of pesticides made subsequent 
medical management of poisoned patients particularly complicated.5% 

Another major problem in the South was pesticide storage, disposal 
and waste. For instance, the Pesticides Trust reported that in 1985, the 
inhabitants of the city Kalaa Seghira, Tunisia, signed a motion urging 
the Ministry of Agriculture to deal with “600 tons of HCH and 70 bar- 
rels of malathion which are deteriorating, and whose fumes are intox- 
icating the neighbourhood making people sick”.® Indeed, during the 
1970s, the industrial countries’ exports of banned pesticides, frequently 
already beyond expiry, effectively turned many areas of the Global 
South into a dumping site for pesticide waste.% As a result, unregulated 
pesticide disposal fostered the increasing spread of toxic materials into 
the environment, including the contamination of ground water. Poor 
household storage and disposal, as well as the reuse of poorly cleansed 
pesticide bottles, barrels or cans as water containers or cisterns further 
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exacerbated serious risks to the environment and human health. In 
order to call attention to the problem of hazardous pesticide waste in 
the Global South, pamphlets and articles frequently featured images of 
leaking pesticide barrels or unsafe reuse of pesticide containers. 

Taken together, for PAN-activists and other environmentalists, all 
these factors resulted in the regular and widespread incidence of poi- 
soning as well as continuing environmental degradation in the Global 
South. For this reason, any calculation of pesticide safety levels had to 
focus on the real risks to health. Describing the risks of pesticides only 
as if they were used sparsely, handled correctly and supplied with appro- 
priate protection did not produce reliable data. Neither did ignoring 
long-term factors such as pesticide disposal and water contamination. 
In short, pesticide activists were calling for “real-world evidence”, to 
borrow a term from the medical sciences, in evaluating the benefits and 
the costs of pesticides.°' For them, risk-benefit analyses concluding that 
local benefits derived from the use of pesticides exceeded the risks to the 
public were obviously operating with false parameters. This critique not 
only challenged established certainties, such as the dominant policy tool 
of cost-benefit analyses, but pictures of barefoot children spraying pes- 
ticides, people drinking from old pesticide cans or masses of discarded 
pesticide containers also developed a visual narrative of environmental 
hazards in poor countries that is still universally understood. 


Conclusion 


What can we learn from the ways environmental activists tried to 
establish knowledge claims during the pesticide controversy? Why do 
their “practices of evidence criticism” matter for broader historical 
and sociopolitical inquiries? Could they change the precarious status 
of environmental knowledge? Following historian of science Moritz 
Epple, perceptions of weakness concerning knowledge are functionally 
related to historical change.‘ Regarding the development of late modern 
knowledge societies, the editors of this volume emphasize how dynam- 
ics of destabilizing evidence for established certainties and attempts 
to re-stabilize them determined the way in which societies decided on 
key issues in the late 20' and early 21 century.5* With respect to the 
research on discourses of weakness and resource regimes in the history 
of science, pesticide criticism showed several features of “weak knowl- 
edge”. Indeed, it combined the dimensions of “epistemic weakness”, as 
it was difficult to prove, and “practical weakness”, as it was seen in 
opposition to agricultural progress and economic growth. Regarding the 
dimension of social and cultural weakness, however, a more nuanced 
picture emerges: Although pesticide criticism started with a weak insti- 
tutional anchoring, its supporters became more numerous, passionate 
and powerful and therefore developed a strong cultural embedding.‘ 
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As such, pesticide criticism never developed an independent institution- 
alized structure of knowledge production, yet it had a transformative 
role in environmental discourse. This was due to the close relationship 
between established science and international environmental activism 
on the one hand, and the political and normative framing of the pesti- 
cide problem on the other. 

Protests against pesticide exports to the developing world during the 
1970s and 1980s produced a specific form of lay criticism by appro- 
priating evidence from diverse backgrounds. If we understand evidence 
as something that is not stable but constantly constructed and re- 
constructed in complex negotiation processes between experts and the 
public, it offers a lens through which we can better understand its polit- 
ical dimension. This perspective sheds light on evidence as a resource 
and therefore on interlinks with different forms of power, especially 
in knowledge-based societies. In this regard, the pesticide controversy 
illuminates how environmental knowledge could rise to pre-eminence. 
Real-world evidence for the risks of pesticide use in the South in the form 
of pictures and alarming numbers would appear on the front pages of 
newspapers and receive considerable attention from administrators and 
policymakers. What made evidence practices by environmentalists spe- 
cific was how they reused official data for their own arguments and 
questions, thereby turning results from secondary sources — often with 
opposing agendas - into evidence for their own cause. Combined with 
dramatic visual evidence, they added a real-world dimension to pesticide 
use in the South. Contextualizing evidence, recycling it and using it for 
the opposite purpose points to the portability of evidence as a resource 
of power that can be deployed by influential industry lobbies as well as 
by marginalized groups. However, although pesticide activism signifi- 
cantly changed the discourse on pesticide export and called attention to 
its devastating consequences in the developing world, regulatory effects 
were remarkably poor. Pesticide activism and the formation of environ- 
mental knowledge was not strong enough to ground sustained and last- 
ing action against pesticide hazards in the Global South. 

Nevertheless, the debates on pesticide exports point to a pivotal 
moment in political and environmental history as they reflect the shifting 
environmental discourse during the late 1970s and the way it opened up 
for global questions. During the pesticide controversy, environmental, 
human rights and health activists challenged established certainties by 
denouncing national solutions and pointing to the fundamentally global 
nature of the pesticide problem. A decade after Silent Spring destabilized 
the myth of DDT as a “miracle chemical”, environmental contamination 
in the South showed that Western environmentalism had been contained 
within American and European borders. For environmental activists 
from the Western world, demanding bans of dangerous substances 
in their respective home countries no longer sufficed. International 
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coalitions such as PAN called out how environmental regulation differ- 
ences created a world of environmental inequality. This shift to a more 
global perspective, however, implied a closer collaboration between cit- 
izens from industrial countries and the developing world. Compared to 
the “scientific” criticism of Silent Spring, the influence and authority of 
environmental criticism now increasingly relied on access to the South, 
the ability to present evidence from these places and finally, on personal 
contact with its inhabitants. Ultimately, though relying on stark power 
imbalances and asymmetries in exposure to risk, this shift brought an 
increasing recognition of local knowledge. 
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9 Participation as Evidence 
Contestation 


The Ambiguous Balance of Social 
and Epistemic Involvement through 
Citizen Science! 


Kevin Altmann and Andreas Wenninger 


Thanks to digital technologies and the ongoing transformation of science 
communication, the boundaries between science and society have become 
progressively more porous. In the context of digital platforms and media, 
and in the light of science policy programs such as Public Understanding 
of Science, Public Engagement with Science and Technology or Open 
Science, the closure of science is increasingly perceived as problematic 
in public debates. One of the frequently mentioned problems in respect 
of the supposedly widening gap between science and society is that the 
actual human and societal needs of society are not (or no longer) per- 
ceived by science and that science therefore does not provide adequate 
solutions to the urgent problems of humanity. Participation and citizen 
science are often seen as a necessary corrective to this tendency, not inev- 
itably by dissolving or shifting boundaries, but through the emergence 
of corridors where laypeople can gain access to scientific knowledge 
production. However, due to the fact that a corridor also has limitations 
of its own, the ways of access are not all-encompassing but defined in 
specific ways. The issue of ecological sustainability is just one example.’ 
One aim of science communication is to disseminate scientific ration- 
ality from academia throughout society using more engaging forms of 
communication. One can see citizen science, conversely, as a movement 
to integrate people from outside academia as representatives of (civil) 
society within the social dimension of science, meaning that people are 
included in research as addressable actors with a more or less concretely 
defined opportunity to participate. Participation can be limited to a few 
mouse clicks or constitute an (equal) right to speak in scholarly discus- 
sion. This is one way in which corridors enable exchange between sci- 
ence and society. From the perspective of science, however, such opening 
processes can easily be perceived as de-stabilization if lay participation 
is accompanied by a contestation of the evidence put forward by pro- 
fessional scientists. The assumption that this involvement in the social 
dimension also offers opportunities to influence academia in its factual 
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dimension - i.e. the ability for participants to seriously co-determine the 
topics, research methods and evaluation in the research process, which 
represents another corridor to enter scientific knowledge production - is 
usually accepted without reflection.* The following article offers a first 
step toward more nuanced considerations in this regard by differenti- 
ating between different corridors of exchange through citizen science, 
especially considering the open question of whether certain boundaries 
between science and society will be maintained or will shift due to lay 
participation. We will describe these corridors in more detail later as 
modes of citizen science. 

Citizen science refers in a broad sense to research projects and activ- 
ities in which professional experts and laypeople work together on sci- 
entific knowledge production. The label citizen science first appeared 
in the 1990s and the activities subsumed under it have been steadily 
increasing since then - strongly driven by digitization since 2010.° The 
spectrum of forms of participatory research ranges from the reten- 
tion of a classical understanding of science, which assigns the partic- 
ipants comparatively marginal tasks in the production of knowledge, 
to projects in which laypeople organize the entire research approach 
autonomously. Overall, the diversity of citizen science “makes it diffi- 
cult, and probably counterproductive, to speak of citizen science as a 
single or coherent practice, because it includes practices with different 
actors, missions, and values”.° Besides the role of citizen science in 
present scientific funding policy, the heterogeneity of citizen science 
becomes apparent through various institutional formations’ in aca- 
demia.’ The establishment of citizen science platforms like Zooniverse 
and Birger schaffen Wissen (Citizens Create Knowledge) or interna- 
tional umbrella organizations as the European Citizen Science 
Association (ECSA) are examples for bundling citizen science activi- 
ties and actors.” Publication formats have been established over time, 
in which actors from different backgrounds discuss and elaborate the 
various citizen science activities as part of the orientation of the citi- 
zen science field.!° 

Science today seems to be organized in such a way that it guaran- 
tees its thematic openness (anything can become the subject of scientific 
research). Nevertheless, there are various measures designed to ensure 
the independence of science from non-scientific interests. According to 
some, the ways in which research findings are obtained and the evalua- 
tion of scientific results is ideally left exclusively to certified experts: 


To produce useful results for society, such as knowledge with practi- 
cal applications and policy implications, scientists should be allowed 
to make decisions within their domain of expertise, free from out- 
side interference and control.!! 
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We term this professional control. Direct participation in the epistemic 
core of science thus seems difficult or even impossible for laypeople (i.e. 
persons without appropriate credentials). Despite all the current changes 
regarding the relationship between science and society, the epistemic 
core of institutionalized science remains relatively stable: 


While a transformation is taking place in the social dimension and 
new actors are being admitted, authorities are being questioned and 
old structures are being broken up, comparatively little movement 
can be observed in the factual dimension [...] The opening of the 
social dimension is taking place with the simultaneous closing of the 
factual dimension.'? 


Given the rise and establishment of citizen science, this appears paradoxi- 
cal. Our previous investigations of citizen science projects have shown the 
varying dynamics between opening and closing scientific participation: 


the inclusion of people (social dimension) is subject to multiple 
socio-technical restrictions and channelings. Within the project con- 
texts, these have the function of counteracting the increased participa- 
tion as a result of opening up in one dimension (social, factual or time 
dimension) by restricting participation in other dimensions, not only to 
make the projects practically manageable, but also to maintain profes- 
sional control in the project contexts despite increased participation." 


Participation in the social dimension has tended to lead to closures in the 
factual dimension. Against this background, we investigate the following 
guiding question in this chapter: What citizen science activities enable not 
only participation within the social dimension of science, but also in the 
factual dimension? Which is to ask whether and to what extent laypeople 
can participate in the creation and conception of research projects. Such 
citizen science activities would potentially allow for the contestation of evi- 
dence offered by certified scientists through extra-scientific participation, 
e.g. by introducing new and challenging content, views or practices. Our 
question also involves the extent to which citizen science makes the reali- 
zation of a contestation of evidence adjustable in order to mediate between 
the opening and closing processes of scientific knowledge production. 

In the first section, we outline the different expectations associated with 
the emergence of citizen science and to what extent they carry narratives 
of evidence-critical participation. In the second section, we introduce the 
diverse modes of citizen science and examine their respective potential for 
evidence contestation and how these modes organize lay participation in 
various degrees. For this purpose, we situate the modes in a schematic rela- 
tion to academia and the prevailing notion of epistemic participation. In the 
third section, we consider the mechanisms of structurally enabling evidence 
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contestation for selected modes based on specific cases. Finally, we exam- 
ine the interplay of the different modes, which allows for moderate evidence 
contestation in citizen science. We find that evidence contestation is not a 
phenomenon concerning citizen science in general. The heterogeneity of cit- 
izen science allows contestation only in very specific ways, and then only 
very moderately. This serves the safeguarding of the common production 
of scientific knowledge from potentially dangerous influences through lay 
participation but still permits the feeding in of new perspectives. Therefore, 
we are not focusing on the actual contestation of evidence through lay par- 
ticipation, but reflect on the structural prerequisites for an influence on the 
factual dimension of science through various modes of citizen science. 


Divergent Expectations on Participatory Research 


In the increasingly established and sophisticated field of citizen science, 
one can identify various demands and expectations of participatory 
research, both within the field and from outside. One can “see citizen 
science as essential to closing the gap between society, science, and poli- 
tics. Citizen science is seen as producing relevant knowledge, but also as 
building connections between disparate institutions”."4 

Common self-portrayals of citizen science activities frame it as a 
democratizing research approach to the production of socially robust 
knowledge with the emphasis on research that is thus more relevant to 
society.!5 At the same time, the concept of citizen science is gaining polit- 
ical weight.!° Now, in addition to the claim to social relevance, the devel- 
opment of general requirements and standards for citizen science activities 
points to a progressive professionalization of the field. These standards 
aim to secure, evaluate and control scientific evidence under the premise 
of lay participation, as, for example, the ECSA’s ten principles of citizen 
science show: “Citizen science projects have a genuine science outcome. 
For example, answering a research question or informing conservation 
action, management decisions or environmental policy”.!” 

We understand the cross-project formulation of guidelines as a means 
of ensuring the scientificity of participatory research and thus as a 
form of boundary work between science and non-science.'® The elabora- 
tion of scientific principles to regulate access to participation in science 
is intended to filter out content and actors (including political activism, 
economic interests and anti-scientific efforts) that may endanger the gen- 
eration of (scientific) evidence. 

These different expectations give rise to a tension between the pre- 
servation of scientific premises and a possible challenge to classical 
evidence production by citizen science. The establishment of participa- 
tory research structures now provides the conditions for professional- 
ized science to engage in self-reflective and yet scientifically controlled 
contestation of evidence. But the contestation of scientific evidence, 
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previously reserved for professional researchers, now also encompasses 
civic participants who do not necessarily see themselves as bound by the 
standards of scientific methodology. In this regard, it is crucial to distin- 
guish between two historical lines of citizen science approaches, which 
have different ways of dealing with the tension between epistemically 
effective and scientifically controlled lay participation. 

In this respect, Caren B. Cooper and Bruce W. Lewenstein refer, on 
the one hand, to the US-American line of citizen science, which is mainly 
oriented toward the organization of cooperation between laypeople 
and experts. On the other hand, there is a second, British-European 
line of citizen science,!? which has a much stronger science-critical 
and social-theoretical reflexive approach.? Gwen Ottinger also distin- 
guishes between two traditional lines of public participation in scientific 
research: She contrasts a “social movement-based citizen science with a 
scientific authority-driven citizen science”.?! 

From our perspective, the most globally established US citizen science 
approach does not aim at a fundamental critique or transformation of sci- 
ence, but rather at science-conforming (or scientific authority-driven) par- 
ticipation. However, this does not mean that this form of citizen science is 
less important for social transformation processes. A professionally guided 
and thus “solid” scientific implementation of citizen science can enhance 
its social relevance. Concerns of laypeople (e.g. environmental protection, 
rare diseases) or certain social groups (e.g. indigenous peoples) may thus 
have a greater chance to be taken into account within political decision- 
making processes. However, even within less fundamentally critical 
approaches of lay participation, there are different varieties of citizen sci- 
ence, which offer latent forms of a reconfiguration of classical knowledge 
production. These modes of citizen science - as representations of partici- 
pation primarily conforming to science - can still contain evidence-critical 
components that open up the factual dimension to input from laypeople. 

In what follows, we outline these different modes of citizen science 
and their underlying concepts of civic participation. We ask to what 
extent these respective modes show potential for not only making people 
and their labor power available for scientific research in social terms, but 
also for feeding factual-content elements (knowledge) into it. This will 
serve to identify the substantive positioning vis-a-vis academia and to 
show the opportunities for a contestation of evidence by citizen science. 


The Spectrum of Participatory Research and the Positioning of 
Citizen Science in Relation to Academia 


The Modes of Citizen Science 


In order to develop answers to our guiding question, a number of concep- 
tual considerations are required. Since it is difficult — as we mentioned in 
our introduction — to speak of a homogenous concept of citizen science 
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in a useful way, it is methodologically necessary to introduce some differ- 
entiations at this point. This is essential to reduce the exuberant variety 
of forms of the label citizen science to types that are methodologically 
manageable and do some justice to practice. Here we use classifications 
of participatory activities in the social dimension of science that have 
become common in the citizen science literature - the so-called modes 
of citizen science.” Furthermore, the diversity of actor types and disci- 
plinary fields is part of contemporary research on citizen science.” In 
contrast, scientific investigations into the spectrum of opportunities for 
contesting evidence through citizen science are still an open field. 


‘Citizen science’ has mainly been viewed as a way of assisting sci- 
entists in reaching their research goals, ignoring the possibility that 
participatory research could also expand what counts as the scien- 
tific worldview.?* 


To examine the possibilities for evidence contestation in specific modes, 
we combine different methods of data generation and evaluation. 
Primarily this happens in the form of ethnographic observation of group 
and network meetings in the field of citizen science, supplemented by the 
examination of central documents and online platforms. For the pres- 
ent contribution, we make a heuristic reduction of this methodologi- 
cal approach. We enrich our theoretical-conceptual considerations with 
empirical case studies. The focus of our contribution is oriented toward 
qualitative-reconstructive social research?) in order to open up and the- 
oretically reflect on the fundamental structures of meaning, patterns of 
discourse and ethno-methods of the citizen science field. 

After these conceptual and methodological considerations, we first 
introduce the different modes of citizen science. We note that while we 
do not make any empirical statements, i.e. from a sociological perspec- 
tive, the question remains open whether and to what extent the differ- 
ent citizen science actors use the labels of the modes in the context of 
other interests. This may be the case, for example, when citizen science 
projects merely describe themselves as co-creative in order to achieve 
self-interested goals such as research funding or reputation but are never- 
theless hierarchically structured in practice. Such inconsistencies between 
claims and realizations of citizen science can be critically addressed in 
terms of “astroturfing”26 or in the context of a “neoliberal transforma- 
tion of science”.27 Of course, one should not omit these critical reflections 
when dealing with the phenomenon of citizen science. By adopting the 
modes of citizen science from field terminology, we supplement it within 
the framework of our research interest with regard to the potential for 
contesting evidence through citizen science. We thus differentiate four 
modes of citizen science, which are key to our approach (see Figure 9.1). 

The characterization of modes illustrates the diverse conceptions of 
citizen science and the various possible forms of participation. A broad 
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Modes of Citizen Science 


e A larger number of laypeople contribute to a 
research project designed by professional 
academics (mostly in digital settings) 

e Participation is limited in time as well as to 
single or few project phases (e.g. classification 
of research objects) 


Contributory 


e Professional scientists and laypeople work 
together in a research project over several 
project phases (e.g. in the design and evaluation 
of questionnaires) 

e The design and management of such projects is 
usually in the hands of professional scientists 


Collaborative 


e Conception from the beginning in cooperation 
of professional scientists and citizens 

e Collaboration takes place jointly across all 
project phases 


Co-Creation 


e  Laypeople organize a project independently and 
without the involvement of professional 
scientists 

e They independently design their research and 
conduct it themselves throughout all phases of 
the project 


Collegiate 


Figure 9.1 Modes of Citizen Science. Figure by Kevin Altmann and Andreas 
Wenninger. 


spectrum of participatory research has emerged, in which laypeople 
have both the opportunity to participate in science at a low threshold 
(primarily in the contributory and collaborative modes) and to partici- 
pate in citizen science at various degrees of self-direction and conceptual 
work (primarily in the collegiate and co-creation modes). Our impres- 
sion is that citizen science is not simply an addendum to science but is 
establishing itself as a science-related network that is largely engaged 
in balancing divergent expectations from different sectors of society 
through its heterogeneity. The importance of the analytical focus on 
the ideal types of participatory research is particularly evident in the 
“increasingly institutionalized citizen science movement”.?® In order to 
understand the ways in which these modes of citizen science — in addi- 
tion to serving various functions, e.g. educational - can also generate 
opportunities to contest scientific evidence, it will help to locate them 
vis-a-vis academia. 


The Spectrum of Participatory Research 


The proximity or distance to academia generates insights into the extent 
to which, for example, professional control is evident in the modes 
of citizen science. This in turn determines the degrees of freedom of 
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High professional control Incorporation 


Contributory 


Alternative to 
academic 
research 


Assimilation O Collaborative 
with academic 
research 


Co-Creation 


Collegiate © 


Infiltration Low professional control 


Figure 9.2 Structure of the coordinate system and location of the modes of citi- 
zen science. Graphic by Kevin Altmann and Andreas Wenninger. 


participation, which we understand as structural conditions for a con- 
testation of evidence. In particular, we are interested in the question of 
what we term the capacity for influence. This means the opportunity for 
laypeople to feed their specific content into science and their potential 
to question established procedures of scientific research. With the term 
capacity for influence, we do not primarily mean the scientific outcome 
of projects, measured in terms of peer-reviewed publications, as in the 
study by Dick Kasperowski and Thomas Hillman.?” Rather, we see this 
in qualitative terms, i.e. the potential to exert any influence at all on 
the factual dimension of scientific research for laypeople.*° Alternatively, 
to take up the question posed by Bruno J. Strasser et al.: Does citizen 
science produce a “New Science”?*! For us, these capabilities are the 
analytical access to explore the possibilities of evidence contestation in 
citizen science. In this regard, we want to clarify: Our categorization of 
citizen science by modes does not mean that a mode represents “good” 
or “bad” science, or that modes should be normatively compared to each 
other in terms of “better” and “worse”. A mode with a high professional 
control is thus not automatically better science than others. Our follow- 
ing scheme is likewise not designed to define the boundaries of science 
and non-science. We understand the modes of citizen science themselves 
as those definitions where the field itself locates its outer boundaries. In 
order to illustrate and specify our previous considerations, we outline 
the following schematic system of coordinates. 

We localize the modes based on three scales, each consisting of two 
poles facing each other (see Figure 9.2): 


1 Assimilation with and alternative to academic research: We under- 
stand the pole Assimilation as the (in its maximum form) quasi- 
silent integration of lay participation into the structures of academic 
research.** In contrast, alternative means the establishment of a 
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separate, civically organized research identity beyond the infra- 
structures and professional control of science. In other words, those 
modes of citizen science that are relatively close to the pole of assim- 
ilation, in our view, primarily follow the organizational structures 
of scientific evidence production (project design, time planning etc.). 
Modes in proximity to the pole alternative conversely offer more 
potential for feeding in factual lay content. Alternative in this case 
does not mean non-science, but a more self-initiated way of practic- 
ing scientific participation. 

2 High and low professional control: High professional control 
means the scientifically guided evaluation of cooperative work with 
laypeople. We see a high degree of professional control primarily 
in science-initiated activities for preserving and implementing scien- 
tific guidelines in participatory research. Low professional control 
indicates an opening to the possibility of developing alternative per- 
spectives and bodies of knowledge. This potentially offers a greater 
influence in the factual dimension. However, (smooth) connectivity 
to academic research is not possible here, or only with difficulty. 

3 Incorporation and infiltration: Incorporation represents (in its max- 
imum form) the adoption of the scientific understanding of pro- 
fessionalized research through the complete embedding of foreign 
components into science (e.g. when laypeople contribute to a profes- 
sionally prefabricated research conception). Infiltration also means 
the influx of foreign entities into science; however, they do not lose 
their property of otherness and challenge science epistemically to a 
greater or lesser extent, albeit with comparative difficulty. 


The contributory and collaborative modes locate themselves in the left 
half of the scheme, which we frame as the inside area of the partici- 
patory spectrum. Therefore, they are in proximity to the poles assim- 
ilation, high professional control and incorporation. These modes are 
characterized above all by the fact that they offer selective access to 
individual research phases and that both the project conceptions and 
the joint research activities are determined by the interpretive authority 
of professional researchers.°* So inside does not mean being inside sci- 
ence as a closed area, but being part of established processes of scientific 
knowledge production. “Scientists generally design projects to which 
members of the public contribute data but also help to refine project 
design, analyze data and/or disseminate findings”.>° 

In our view, these modes fulfill two things: On the one hand, the 
reproduction of classical scientific knowledge production and thus also 
the safeguarding of evidence; on the other hand, they generate a socially 
broad anchoring of science by enabling low-threshold participation for 
laypeople. This can be, for example, access to different research phases 
without structural hurdles such as the need for an academic degree. 
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The relatively high degree of professional conceptualization and guid- 
ance limits the discursive space for participatory research, which offers 
little scope for evidence contestation. Because of the connectivity to aca- 
demic research structures, we refer to them collectively below as assim- 
ilative modes. 

The collegiate mode locates instead on the right half of our scheme 
near to the poles alternative, low professional control and infiltration 
and thus beyond or respectively outside invited participation?‘ of scien- 
tific research, but still in connection with the scientific system. Collegiate 
opens up greater scope for a potential contestation of evidence through 
greater capacity of influence on the factual dimension. These capacities 
arise in collegiate mode from the changing constellations of expertise. 
Here, laypeople can have a pronounced or even the sole interpretive 
authority over the design of participation. 

The mode co-creation is located exactly in the middle and therefore 
at the border areas of our scheme. Border areas indicate the hybridity 
of citizen science activities, which often show mixed forms of assim- 
ilative and alternative elements of civic participation. Citizen science 
cannot always be clearly assigned to one pole and does not always have 
to remain in the same relation to academia, e.g. due to changes in pro- 
ject conceptions. We speak of border areas to reflect that citizen science 
projects do not necessarily represent a particular mode and their orien- 
tation may change over time. However, by positioning itself between the 
assimilative and alternative pole, co-creation represents neither a com- 
plete appropriation by, nor a clear demarcation from academic research 
structures. The common research identity is fed by the equivalent distri- 
bution of participation between researchers and laypeople. Even with- 
out the exclusive orientation toward the formally established procedures 
of professional research, the connectivity to academic institutions and 
their control mechanisms remains. Instead, professional control can 
take place cooperatively, e.g. when both scientists and laypeople eval- 
uate their collaboration. The positioning of co-creative citizen science 
“between Science and Civil Society”*” enables structural opportunities 
for a potential contestation of scientific evidence. 

We understand citizen science projects not only as partial forms of 
civic participation, but also as part of more general (cross-project) con- 
ceptions (modes). The schematic location of the modes allows us to grasp 
the diverse positions that citizen science can take in relation to academic 
research structures. The preceding mapping is thus essential, since from 
this localization the potential for contesting evidence becomes visible 
and understandable. In the following, we focus specifically on the col- 
legiate and co-creation modes, as these two offer the greatest potential 
for contesting evidence through lay participation. We will elaborate the 
specific mechanisms for creating contesting opportunities for laypeople. 
At the same time, however, we illustrate which epistemic regulations go 
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along with these opportunity structures for contesting evidence. We will 
illustrate this by means of reference to empirical case studies. 


Collegiate: On the Topothek Project and the 
(De-)Realization of Epistemic Potential 


As the spectrum of participatory research shows, an alternative, not 
(primarily) academia-initiated conception of citizen science occurs in the 
field of citizen science, which represents a structural response to non- 
scientific expectations of participation in science. The citizen science 
platforms themselves address these civic formats of research, which we 
have already identified as participation in the collegiate mode:°® 


In this context, cooperation between research institutions and insti- 
tutionally unaffiliated individuals can take very different forms, 
ranging from completely self-initiated ‘free’ projects [...] to guidance 
by scientific institutions lay people [emphasis in original].% 


Such free projects in the collegiate mode and their position outside pro- 
fessionalized research structures evade the control mechanisms found 
in the collaborative/contributory modes. The question arises of how 
to make this potential loss of professional control manageable in the 
collegiate mode but still recognize these alternative forms of citizen 
science as a stream of public participation in science. The case of the 
collegiate project Topothek and its discursive reappraisal in the course 
of the platformization of citizen science serves as a useful example here. 

Topothek“ is an online platform by and for people interested in local 
history, who collect historical material in their respective local topo- 
theques, digitize it and make it available online. The vast majority of 
topotheques can be viewed globally by anyone with internet access. The 
goal of the Topothek is to build an online archive that makes it possi- 
ble to store local historical material permanently and thus make local 
historical knowledge accessible (for historical research and the general 
public). The project is run exclusively by interested laypeople; profes- 
sional scientists are neither actively involved nor, to our knowledge, has 
the Topothek been used in the context of academic-historical research 
so far. The Topothek occasionally networks with museums/historical 
archives and schools, but there is little contact with traditional research 
institutions. Partly to explicitly demarcate themselves from such institu- 
tions, they describe the platform as an alternative, pre-scientific knowl- 
edge producer. In this regard, contributions from citizens are 


detached from the contexts of classical institutions, de-contextualised 
and re-contextualised within the framework of the Topothek as 
data close to real life. The de-contextualisation becomes [...] visible 
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as an evidence strategy in the sense of ‘real-world evidence’: local, 
individual, personal, contemporary and real-life ‘data’ and ‘infor- 
mation’ are the raw material for alternative form of ‘knowledge’.*! 


Its connectivity to academia is thus not very pronounced. It is difficult to 
discern whether this is a deliberate strategy on the part of the platform 
operators, or whether it is a consequence of non-consideration by aca- 
demic historians. Their self-positioning fluctuates accordingly between a 
supplement to and preliminary work for science on the one hand and a 
(more detailed, more lively) alternative to academic science, at least when 
it comes to local historical research. It is difficult to evaluate the scientific 
output, which we have not been able to determine so far. Topothek runs 
outside of academia but still makes some claim to scientific relevance. 
The capacity for influence here is great, as laypeople can potentially con- 
tribute their perspectives and bodies of knowledge without hindrance. At 
the same time, however, the connectivity to academia is severely limited, 
so that this potential cannot unfold there, at least for the time being. 

The intriguing aspect, however, is not the project itself and how spe- 
cifically evidence is produced there. Rather, the framing of the project 
by the institutional actors becomes significant. We do not intend to show 
whether or not citizen science in mode collegiate constitutes a concrete 
evidence contestation. Rather, we want to use the case to investigate 
which structural possibilities citizen science in the collegiate mode ena- 
bles at all in order to be able to perform evidence contestation. 

In the context of an international citizen science conference, the 
participants (mainly professional researchers, platform operators and 
organizers from the field of citizen science) of a particular workshop dis- 
cussed the example of the Topothek. The session aimed to optimize the 
self-presentation of projects on citizen science platforms in order to best 
address interested citizens and possibly encourage them to participate. 
It is worth mentioning that projects listed on these citizen science plat- 
forms have to meet specific criteria in order to be visible on the platform. 
Without fulfilling these criteria, getting listed on the platform is not 
possible due to the platforms own policy. These criteria include various 
aspects, the most significant being both the scientific orientation of the 
projects, i.e. formulating a concrete research question, as well as the 
special emphasis on the inclusion of citizens and relevant societal goals. 

Starting from these premises, a discussion arose in the course of the 
workshop about the extent to which the Topothek is a scientific project 
and thus citizen science, since no concrete research question has been for- 
mulated in the self-description of this project. Participant “A” (professional 
researcher and also member of a national citizen science platform) asked 
whether the Topothek had a scientific orientation (as required, among other 
things, by the criteria of the platform). Participant “B”, who is involved 
in the listing processes of another citizen science platform, answered this 
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question and explained the background of the listing of the Topothek on 
the platform. We present the excerpt from this discussion in the following: 


A: What I find interesting, if I might now nitpick a bit, that’s kind of the 
question here... we actually also say, often I think, that it’s impor- 
tant to say that we posed a research question, and that it’s a research 
project, and so where in fact is the research question here? But I 
actually understand it more like this: This is actually a large reposi- 
tory and starting from it, you can then ask a wide range of research 
questions. But if we now take a super critical view, we could say, 
well, there’s actually no research question being asked here, is there? 

B: Right, I'd certainly agree with that. Nevertheless, it is/it corresponds 
to our quality criteria, because we’ve written into the quality criteria 
that a project must either have a research question or a goal, or it 
must build up an infrastructure, so to speak [...] the goal [in another 
project, which is similar to the Topothek, authors’ note] was simply 
to sequence the human genome and to be able to start new research 
based on that. And in principle, a topotheque is the same thing on a 
community-historical level. 


[...] 


A: That's a really major question, because I, because I have the feeling 
from some discussions that in citizen science this term is somehow just 
expanded and that you can also initiate projects that don't have a super 
clear research question defined down to the last detail. But I think for 
me it’s not always very clear in my head how strict or how very close 
it has to be to research or what it’s supposed to be. I do totally get 
what you’re saying [participant B], yeah, and the, I think for some peo- 
ple, there are some projects that are kind of based on this “we’ll create 
something first and then well take a look at it”. (...) But I sometimes 
still urge people to say, what exactly is your research about, yeah? 


[...] 
B: More than happy to oblige! 


It is apparent from this excerpt that “A” connects the question with the 
distinct claim to citizen science to raise a scientific question and to make 
it explicit in external communication. In contrast, “B” sees the criteria 
of the platform fulfilled in that the project formulates a clear goal by 
addressing a topic relevant to science and building up and providing a 
potentially scientifically relevant infrastructure due to the ambivalence 
of project alignments of the citizen science platform. 

We want to point out that at the time of the listing of the Topothek, 
the criteria of the platform were not yet as strongly formulated as they 
are at present. Nevertheless, at the time of the presentation of the project 
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at the mentioned conference, the project had been running for several 
years without a clear scientific question,” but remained a relatively free 
collaboration between laypeople, while the outcome of the project was 
not taken up by professionalized research or getting evaluated by sci- 
entific researchers during the project itself. So far the results primarily 
serve a socially relevant goal of documenting historical details of local 
communities. Especially in light of the fact that the citizen science plat- 
form, where the Topothek is listed, applies clear scientifically focused 
criteria to new projects, this illustrates the status that the Topothek pro- 
ject has on the platform. 

In the case of the Topothek, “B” emphasizes (rather than stating a 
crystal-clear scientific question) the alternative possibilities offered by 
the project, e.g. to make knowledge gaps visible that academic research 
has not yet (sufficiently) perceived. “B” ascribes to this collegiate project 
a different role than to the professionally controlled and assimilative 
projects, which have dedicated scientific questions. 

Thus, the collegiate mode serves as a kind of antithesis to traditional 
research, on which professional scientists (in our case actor “A”) can 
explain their claims as to what a decidedly scientifically oriented citizen 
science should look like in contrast to such an alternative mode like 
collegiate. Instead of these scientifically driven projects, citizen science 
in the mode collegiate ensures the visibility of alternative perspectives in 
science in order to meet the expectations of extra-institutional actors, 
e.g. local communities. This enables the occurrence of lay perspectives 
and unattended topics in the scientific field, which represents a structural 
opening of the factual dimension due to the enhanced opportunities of 
doing self-determined lay research beyond scientific research structures. 
This legitimates the listing of the Topothek on the platform. 

This is not only evident in the style of self-representation of projects. 
Citizen science platforms normalize the possible forms of alternative 
participation by explicitly not presenting them as activist action or even 
branding them as anti-scientific endeavors. Due to Thomas F. Gieryn, 
those brandings can be functional to draw a line between scientific and 
non-scientific interests, as he states in his findings about scientific bound- 
ary work and the establishment of science against former gatekeepers of 
knowledge like the church. Against such a branding, the emphasis on 
the societal relevance of the Topothek intends that the project not only 
remains acceptable but can also be promoted as desirable and innova- 
tive, especially to those who might criticize the lack of a decidedly scien- 
tific question (in this case actor “A”). The literature in the citizen science 
field also specifically addresses alternative modes such as collegiate. 
In this regard, Jennifer L. Shirk et. al explicitly refer to the program- 
matic innovation potential of the collegiate mode. A specific scientific 
role is thereby attributed to the collegiate mode, even if it lacks prac- 
tical integration in the processes of professionalized project activities: 
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In this model, professional and amateur researchers may collaborate 
only when an amateur writes and submits findings for peer review and 
publication. Although often overlooked or highly critiqued, commit- 
ted amateurs can make critical contributions that may not otherwise 
transpire owing to a lack of resources, time, skills or inclinations in the 
professional scientific community.** 

In addition to the social and factual dimension of participation, we take 
the temporal dimension also into account, in which the collegiate activities 
can also become functionally effective in practice. As explained in the con- 
tribution by Karin Zachmann and Stefan Esselborn in the present volume, 
social movements can call for alternative forms of research, which histori- 
cally have led to alternative scientific initiatives. According to Zachmann 
and Esselborn, these initiatives have themselves taken on a variety of 
forms. For example, different efforts to establish parallel research that aim 
to examine and correct research results from established science. Other 
actors have sought to establish decidedly alternative forms of knowledge 
production. The Oko-Institut (Institute for Applied Ecology), which 
emerged from the environmental movement of the 1970s/1980s as an 
alternative research institution, should be mentioned here as an example 
of the institutionalization of scientific research. The Oko-Institut origi- 
nated outside academia but achieved acceptance by established science and 
the scientific policy advice sector in the long run. The institute integrated 
itself into academia and thus changed its alternative status. However, 
this in turn also achieved a certain transformation of research through 
the institutionalization of the Oko-Institut. The significance of citizen sci- 
ence in the mode collegiate as a representative of alternative perspectives 
offers the possibility of future permanence. Whether a development sim- 
ilar to that of the Oko-Institut is possible, is a task for further research. 

In the context of citizen science, the collegiate mode offers potention- 
ally the greatest opportunities for evidence contestation, despite, or per- 
haps because of, the largely missing connectivity to the professionalized 
research structures of academia. But this structural opening does not 
mean that these greater potentials of influencing knowledge production 
lead to an actual contestation of scientific evidence. Because at the same 
time, the collegiate mode also assumes a semi-epistemic role, in which 
this mode is potentially not part of concrete elaborations of participatory 
frameworks, publications and practical applications inside the academic 
field. Although the literature in the field of citizen science does identify 
the collegiate mode as part of participatory streams, it shows that the 
collegiate mode is less relevant when it comes to analyzing the influence 
or concrete content orientation of citizen science.* In research practice, 
too, the collegiate mode is the least implemented form of participatory 
engagement among the four modes.*° The shown excerpts illustrate the 
more representational relevance than the actual questioning of scien- 
tific evidence that is assigned to the Topothek project by the discussing 
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scientists. The possibility of contesting evidence through citizen science 
in the collegiate mode is thus double-edged: On the one hand, the struc- 
tural prerequisites are created to challenge scientific evidence beyond 
professional control mechanisms, due to the intense and more auton- 
omous involvement of laypeople in the collegiate mode. Nevertheless, 
in the practice of scientific usage, this potential often remains unused 
because the precarious connectivity to the formats of academia is miss- 
ing. Therefore, citizen science in the mode collegiate remains in a posi- 
tion outside the structures of professionalized criticism of scientific 
knowledge. The example of the collegiate project Topothek illustrates 
that mass participation by laypeople is possible in modes other than the 
assimilative. However, the lack of connectivity to academia does limit 
an epistemically effective integration of alternative citizen science in sci- 
entific institutions, their infrastructures and their respective academic 
reputations. In the special case of the Topothek, the given framings of 
the project by professional scientists (as a socially relevant form of self- 
initiated lay participation) and the missing connectivity to the criteria 
and control structures of professional science imply a limitation of real- 
izing the potentials for an actual contestation of evidence. 

Given the lack of actual contestation of evidence in the modes of 
citizen science presented thus far, the question arises: Which forms of 
citizen science now enable a contestation of evidence? In the following, 
we describe the mode of co-creation, especially with regard to the aspect 
of connecting citizen science to various interests. From our perspective, 
this mode is most suitable for balancing the asymmetries between the 
assimilation and alternative modes. It serves the different expectations of 
science and non-science for citizen science simultaneously and equally, 
without creating too one-sided connectivity neither with regard to the 
scientific premises of professionalized research nor the non-scientific 
demands for participation. We will also illustrate this with reference 
to a specific case to consider how evidence contestation within the co- 
creation mode can be realized and managed. 


Co-Creation between Exchange and Persistence: The 
Approaches of Questioning Scientific Claims 


In our previous case studies, we investigated one co-creation project 
named Patient Science.” Certified scientific experts from academic 
and non-academic fields recruited citizen scientists as so-called patient 
researchers. Professional and patient researchers together designed and 
organized a research project. A general goal was predefined, which was 
concretized with questions prepared (by the professional researchers) in 
small groups, intending to address problems in the everyday life of cystic 
fibrosis patients and to identify a specific need for research. We illus- 
trate with the following summary field notes taken during ethnographic 
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observations of this project, to which extent evidence contestation and 
influence for patient researchers on the factual dimension can take place 
within this mode of citizen science. The quotes are anonymous literal 
statements of the observed actors in the field from one of the authors. 

When comparing several possible research topics, the involved actors 
compared various dimensions with each other. These included the rel- 
evance for science, the benefit for the citizen scientists and the science 
literacy (here it was determined whether the topic could be implemented 
more as traditional academic research or whether it required more 
application-oriented research). Despite the intensive involvement of the 
patient researchers, the professional scientists dominated the regular 
events for long periods. This was mainly because they usually took over 
the moderation and organization of the meetings. Presumably, this type 
of organization by the professional scientists results unintentionally in 
the patient researchers remaining in relatively passive roles. This gener- 
ates only limited opportunities for patient researchers to significantly 
influence the discussions. Overall, one can say that the professional con- 
trol is very prominent since there is also training on scientific research 
by professionals for the patient researchers. In addition, topics that the 
professional scientists judged to be not scientifically feasible or scien- 
tific enough were dismissed without much contestation. Nevertheless, 
moments occurred repeatedly that could be regarded as contestation of 
the authority of the certified academics and thus also of the evidence pro- 
vided by them. Once, for example, a professional scientist reacted with 
the statement “I feel discriminated against as a professional researcher, 
this is not a level playing field”, because their positive evaluation of 
a topic was not taken up in full. Here the group, through the strong 
influence of the patient researchers, had agreed on another topic. This 
triggered for a moment heated, confusing discussion in the group. The 
topic, which many patient researchers rated as a priority, provoked fierce 
counter-reactions and devaluations by individual professional scientists, 
who said that this topic did not entail a “scientific question” and thus 
did not allow for “operationalization in the scientific sense”. If this topic 
was elaborated, it would take the form of a recommendation, similar 
to those found in lifestyle magazines, for example, such as answers to 
the question: “Is this the right diet for me”? As a result, the profes- 
sional researchers could only partially prevail by merging the two topics 
into one. At the same time, the actors involved mutually agreed that the 
result does not have to be/cannot be a scientific result in a traditional 
sense. Ultimately, an innovative result emerges within the framework 
of co-creative cooperation with the clear signature of citizen scientists, 
but at the same time, boundary work takes place in order to secure the 
scientific authority over the area of academic research. 

The Patient Science project illustrates to what extent non-academic 
actors can question the authority of professional science and its evidence 
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claims. Based on this, we now look at the mode of co-creation as an 
overarching concept of epistemic participation. 

The co-creation mode offers large capacities for influence since not only 
can laypeople be involved in data collection or analysis in large numbers 
(social dimension) but are also represented in the research conception 
(factual dimension) and thus in all research phases (temporal dimension). 
However, the increased capacity for influence remains moderate, as the 
researchers themselves remain an equivalent part of the research process 
and professional control continues to exist. Where the contributory, col- 
laborative and collegiate modes limit the possibilities for critically assess- 
ing evidence in various ways, co-creation offers the option of being able to 
become effective as a layperson in the structures of evidence production 
without creating non-productive tensions, such as major negotiations over 
the conception of a research project. We will illustrate the possibilities for 
evidence contestation through co-creation using the following case. 

For this, we focus on the td-net toolbox of the Swiss Academy of 
Sciences as a co-creative approach. This toolbox is dedicated to the 
further development of co-creative research as a scientific method.*® 
According to its self-description, the toolbox’s overarching purpose is to 
enable heterogeneous cooperation: 


The methods and tools offered by the td-net toolbox specifically focus 
on jointly developing projects, conducting research and exploring 
ways to impact in heterogeneous groups. They are intended to help 
shape collaboration between experts and stakeholders from science 
and practice in systematic and traceable ways.*? 


The toolbox’s idea of cooperation between laypeople and experts builds 
on the concept of thought styles developed by Ludwik Fleck. According 
to Fleck’s concept of thought collectives, mutual influences arise between 
the “esoteric circles” of specialists, the “exoteric circle” of laypeople 
and the gradations in between. This can further lead to a democratiza- 
tion of the esoteric circles, if a majority (e.g. the public) takes a stronger 
position and thus forces an exchange between the thought collectives of 
laypeople and experts.*° 

The intercollective exchange of thought styles as the overall approach 
and specific criterion of the td-net toolbox*! can be exemplified by one of 
the concrete tools. The tool emancipatory boundary critique focuses on 
the empowerment of laypeople and their epistemic capacity. This tool 
serves as an example of the possibilities of evidence contestation in the 
mode co-creation: 


Emancipatory boundary critique consists of a set of questions to 
empower non-experts to uncover normative assumptions underlying 
an expert’s solution to a problem along with the solution’s social 
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and ecological implications [...] All solutions to a problem include 
underlying assumptions [...] In the critical discussion of these under- 
lying assumptions and their consequences the expert is as much a 
lay-person as the non-expert.°? 


The aim of the tool is to enable laypeople to deconstruct the normative 
assumptions of presented scientific solutions in order to not only accept 
solutions, but also to reflect on their backgrounds as a form of emanci- 
pated participation. However, in our view, those questions are not only 
tools for laypeople to contribute their perspectives to a greater extent. 
The formulation of these questions ensures that the exchange of thought 
styles does not lead the scientist to lose their role as the provider of 
solutions to a lay audience: “How are thought styles bridged? Enabling 
a dialogue on equal footing between the experts who propose solutions 
and the affected non-experts bridges thought styles”.*? 

Some examples of the set of questions will illustrate the ambiguous 
balance between the distinct interests of experts and laypeople. The 
questions divide into the following categories: Sources of (1) motivation 
(2) power (3) knowledge and (4) legitimation. We give an example for 
each category:*4 


1 What is (ought to be) the purpose? That is, what are (should be) the 
consequences? 

2 Who is (ought to be) the decision-maker? That is, who is (should be) 
in a position to change the measure of improvement? 

3 What kind of expertise is (ought to be) consulted? That is, what 
counts (should count) as relevant knowledge? 

4 What secures (ought to secure) the emancipation of those affected 
from the premises and promises of those involved? That is, where 
does (should) legitimacy lie? 


The explicit focus of the questions on the backgrounds of the scientific 
solution proposals enables the laypeople to become part of the content 
discussions and also to demand justifications from professional research- 
ers about scientific knowledge. On the one hand, this concerns both the 
level of knowledge itself and what can become the object of knowledge 
here in the first place (3), as well as the consequences of scientific knowl- 
edge and its social impact (4). On the other hand, laypeople are enabled 
to (critically) question the social conditionality of research; especially 
not only in the questions of power relations (2) in research, but also the 
purposes (1) of scientific research. This opens up advanced possibilities 
to contest scientific knowledge that are potentially much stronger here 
than in other modes of citizen science. 

However, it is precisely the content-related focus of the questions that 
shifts the structural component of empowering citizens out of focus, 
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namely who decides which solutions are worth discussing in the context 
of this tool on the one hand and who designs the solutions on the other. 
The agreement of the involved actors still refers to the fact that the ques- 
tions do not intend to challenge the monopoly role of the researcher but 
primarily to stake out the distribution of roles between laypeople and 
experts. The tool is thus based on the agreement of not contesting the 
roles of experts and laypeople due to the fact that the latter are still not 
providing the solutions. They become equal partners with the experts in 
critically discussing solutions, but not as providers, as becomes apparent 
through the output definition of the tool: 


The output is a dialogue about a proposed solution, that openly 
deliberates underlying normative assumptions as well as social 
and ecological implications. The overall outcome is a broader (and 
emancipated) understanding of the proposed solution amongst the 
people involved in the dialog.” 


In addition to the (project internal) interpretation by the td-net toolbox 
of Fleck’s concept of thought styles, we would add the following: Fleck 
emphasizes the persistent tendencies of thought styles. Among other 
things, Fleck points out that contradictory evidence (as it can occur, 
for example, through another thought collective) remains, for example, 
largely ignored or is very strongly attempted to be integrated into one’s 
own thought style.5 This insight coincides with Gieryn’s work on scien- 
tific boundary work, in which one’s own boundaries (and so the thought 
style) are defended against others. Despite intercollective exchange, the 
actual influences thus remain rather marginal. Even under the assump- 
tion of a fundamental change of the primary thought style of a collec- 
tive, it would not disappear completely. It will persist as a foundation for 
new ways of thinking.” 

Thus, the approach of this co-creative tool is precisely not about 
symmetrizing thought styles unilaterally. Rather, it is about maintain- 
ing the different thought styles of various actors by formulating the 
questions in such a way that they protect the interests of the respective 
other. This balancing enables the scientists and laypeople to contin- 
uously enforce their own interests. Therefore, we observe a moderate 
contestation of evidence through lay participation in this case. The 
conception of the emancipatory boundary critique tool offers possi- 
bilities for questioning scientific evidence, but it does not touch the 
hierarchical structures of evidence production and the dominance of 
established science in it. 

In the following, we open a network-theoretical perspective on our 
case from the co-creation mode using the sociological concept of bound- 
ary objects. We do this not only to explore how evidence-critical partic- 
ipation occurs, but also to ask ourselves what functional meaning the 
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modes and their connectivity to academia have for handling a possible 
contestation of evidence. 


Co-Creation as a Point of Convergence? A Network-theoretical 
Reflection on Realizations of Evidence Contestation 


The persistence of different interests and thought styles leads us to the 
assumption that an actual contestation of evidence through co-creation 
does not appear merely through identifying consensus and dissent. 
Moreover, epistemic participation is not realized through the mere recog- 
nition of other thought styles. Instead we hold that, in terms of the sociol- 
ogy of science, co-creation approaches such as the td-net toolbox do fulfill 
the conditions of “heterogeneous cooperation”,’® but more in the sense 
of “boundary objects”.5 In the classic example by Susan Leigh Star and 
James R. Griesemer, a museum constitutes boundary objects. It offers dif- 
ferent artifacts that can have various and locally reconfigurable meanings 
for specific actors, depending on their respective uses and disciplinary 
backgrounds. In this context, Star also speaks of “cooperation without 
consensus”.6! Cooperation between researchers and laypeople, however, 
requires agreements that not only retain their validity within science, but 
also “across time, space and local contingencies”? to acknowledge the 
heterogeneity of actors and their respective point of view. This would be 
the case if, for example, participatory research on air pollution in cities 
is not only used for scientific data gathering, but also leads to concrete 
measures of air improvement for the citizens who participate in the data 
collection. According to Star and Griesemer, the possibility of such com- 
patibility is not bound to a consensus on the content of the collaboration.“ 

What becomes necessary instead are translations between the actor’s 
interests. This means that the different interests of the actors unite under 
one programmatic goal. Star and Griesemer describe this in reference to 
Michel Callon as obligatory passage points.® In the case of the assim- 
ilative modes, this passage point is the scientific evidence orientation, 
while for the collegiate mode it is the distinctiveness of lay participation. 
With the orientation to a specific passage point, the assertion of scientific 
authority takes place.66 However, by focusing on the translation to the 
passage point of one actor and its defense, there would be a danger that 
cooperation would break down if there was no safeguarding of the inter- 
ests of other participants.°’ 

In terms of evidence contestation, this means that both a clear restric- 
tion of opportunity structures for contesting evidence and too much 
openness to evidence-critical influences are problematic in contexts of 
collaboration among heterogeneous actors. From their perspective, Star 
and Griesemer refer to boundary objects that enable the translation 
of such interests into different points of passage. These translations 
then replace consensus on content and maintain the relevance of the 
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overall endeavor (in our case, participation in science) to different social 
worlds.6® Boundary objects create cooperation by translating the respec- 
tive expectations of all involved actors. 

If we relate the perspective of boundary objects to the mode of co- 
creation, it can be understood as that form of citizen science which (in 
its ideal-typical conception) shows itself as a frame of reference to which 
different actors with different interests can appeal without serving the 
partial expectations of science or non-science asymmetrically. Under 
these conditions, evidence contestation becomes realizable. However, 
this does not mean that professional control becomes obsolete. The 
interrelationship between epistemic safeguarding and contestation of 
evidence characterizes epistemic participation through citizen science. 
The concept of boundary objects acknowledges the persistence of the 
actors’ interests and thought styles (as Fleck mentions) through the act 
of translation. 

In the case of the emancipatory boundary critique tool, it is not pri- 
marily a matter of emancipation, but of serving the interests of laypeople 
in co-creation, and yet the structural conditions and structural limits 
mean that the researcher still has control over who offers solutions and 
puts them up for discussion. Cooperation always occurs here in the 
context of professionally organized research and the existing limits of 
roles between laypeople and experts. Co-creation seems to serve as the 
primary mode for epistemic collaboration in order to serve the expecta- 
tions of non-science on the one hand, but without giving up the passage 
point of science on the other. 

To what extent this can be observed in practice and how co-creation 
processes thus enable lay participation in the social, factual and tempo- 
ral dimensions in concrete terms is something that needs to be discussed 
beyond the scope of this chapter in the form of further comparative case 
studies. However, co-creation approaches maintain the structural con- 
ditions of professional control to secure evidence and, at the same time, 
enforce the capacity for influence through lay participation. Co-creation 
thus generates, in our view, currently the greatest possibilities for lay 
inclusion not only in the social and temporal dimension, but also and 
particularly in the factual dimension of science, as an equilibrium of 
participatory and yet scholarly research. A possible contestation of evi- 
dence would thus not be a fundamental questioning of science as the 
primary producer of knowledge. It would take place in the form of the 
inclusion of laypeople in the structures of science and its premises, in 
which potentially critical participation remains adjustable. The possibil- 
ity of challenging evidence through extra-scientific perspectives is real- 
ized here ina factual and not system-related way. We would describe this 
as a moderate contestation of evidence in the co-creation mode. 

In the following outlook, we discuss the reciprocity of all the referred 
modes. We illustrate that the heterogeneity of modes does not simply 
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represent constitutional processes of diverse participatory conceptions 
that are only powerful in their own right. We understand the contes- 
tation of evidence in the field of citizen science precisely in view of the 
arrangement of modes as a network of heterogeneous participation. It 
is only through their interconnectedness that the modes fulfill the func- 
tional requirements for constituting citizen science as a participatory yet 
evidence-oriented approach. 


Outlook: Modes of Contestation? Citizen Science 
as Regulated Critique 


If we look at the modes of citizen science as a whole, we can see that 
they each serve different tasks in shaping participation. The assimila- 
tive contributory and collaborative modes characterize themselves by a 
high connectivity to academia. Through this, we see the reproduction 
of common procedures of professionalized research by the incorpo- 
ration of citizen science activities into established structures of scien- 
tific research. The structural possibilities of evidence contestation thus 
remain largely limited, which, however, enables low-threshold and 
broad participation. 

The other modes, collegiate and co-creation, instead lead to certain 
opportunities of contesting scientific evidence. The alternative collegiate 
mode operates primarily outside of professionalized research, but can- 
not realize its high potential for evidence contestation because it lacks 
the necessary connectivity to academia. The collegiate mode serves here 
rather as a representative of non-scientific perspectives. Nevertheless, it 
offers the opportunity to try out alternative content and methods within 
their framework that can become scientifically relevant at a later point 
in time (see on this the contribution by Zachmann and Esselborn in this 
volume). 

Co-creation, on the other hand, translates the perspectives of various 
actors to produce epistemic cooperation and a controlled opening of 
the factual dimension. Co-creation enables controlled yet epistemically 
effective participation that assimilative and alternative modes can hardly 
provide, as they increasingly regulate or restrict participation in science. 
However, the concession of epistemic impact does not mean that co- 
creation implies a departure from traditional research structures. In our 
view, a possible epistemic participation through co-creation refers rather 
to the involvement of laypeople on the conceptual-content level than to 
the structural reconfiguration of scientific knowledge production and its 
producers. The contestation of scientific evidence thus remains moder- 
ate in the co-creation mode, without developing into a general systemic 
critique of scientific evidence. Here we need to distinguish between chal- 
lenging scientific evidence and challenging the structures of scientific 
evidence production. 
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Even though we have distinguished various forms of participation, 
we see a possible answer to the question of how citizen science as a field 
generates evidence-critical participation precisely in the interplay of the 
modes through mechanisms of opening and closing of scientific knowl- 
edge production. This reciprocity enables a moderate contestation of 
evidence for more than a single mode. The interplay of opening and clos- 
ing means, in simplified terms: A specific mode functions as the advocate 
of the one perspective but is at the same time the antagonist of the other, 
as a kind of trade-off. If the expectation of scientificity is fulfilled by an 
assimilative mode, epistemic participation cannot be fulfilled without 
restrictions, and vice versa. 

A broad spectrum of modes alone does not ensure adequate possibility 
of actual epistemic participation. This oscillates between an opening of 
the social dimension for factually compliant participation (assimilative 
modes) and a closing of the factual dimension through the restriction 
of overly large potential for evidence criticism (alternative modes). In 
these modes, evidence contestation is thus either structurally limited or 
remains practically unrealized. The mode co-creation complements and 
increases the enormous diversity of citizen science and, at the same time, 
directs the epistemic effectiveness of laypeople into controllable chan- 
nels (thus limiting it at the same time). 

Regarding our guiding question (Which citizen science activities offer 
the potential for a contestation of evidence?), we state that the opportu- 
nities for contesting scientific evidence differ depending on the mode of 
citizen science. However, we suggest that the interplay of heterogeneous 
modes and their multiple connectivities to diverse participatory expecta- 
tions is functionally meaningful for the field to enable epistemic partic- 
ipation, but to keep it at a tolerable level for science. We thus formulate 
our thesis of a moderate contestation of evidence not only for specific 
modes, but also as a mechanism of structural arrangement of heteroge- 
neous concepts of civic participation. For a further (network-)analysis 
of the functionality of the different positioning between citizen science 
and academia (which we have hinted at in this chapter), the inclusion 
of a further system- and differentiation-theoretical vocabulary would 
be required. We also see the need for the extension of a sociologically 
informed mapping approach to conceptions of citizen science. 

The crux of the diversity of modes of citizen science is that the open- 
ing of such a network of heterogeneous participation is at the same time 
accompanied by new forms of epistemic restriction for lay participation. 
This is the case if different modes allow partial forms of participation 
(intra-scientific, extra-scientific, conceptual) but do not generate entire 
participation. Although the diverse participation structure initially meets 
the various expectations of different actors, this risks a sustained disap- 
pointment of expectations in practice. This applies both not only for 
the public but also for traditional science that has an interest in a more 
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participatory research. In the sense of truly epistemically effective par- 
ticipation of laypeople, it is therefore important to raise awareness of the 
extent to which a pluralistic program of citizen science contains not only 
inclusion, but also exclusion potential, and, moreover, whether this cor- 
responds to or runs counter to the intentions of various citizen science 
actors. In this respect, we hope that further empirical studies will be 
conducted within the framework of such conceptual considerations. In 
particular, to investigate the realization of capacity for influence through 
citizen science for a productive contestation of evidence. 
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way to try to measure expertise externally is by reference to credentials 
such as certificates attesting to past achievement of proficiency”, see Harry 
Collins and Robert Evans, Rethinking Expertise (Chicago: Univ. of Chi- 
cago Press, 2007), 67. 

Own translation of the quote by the authors. Sarah Ehlers and Karin Zach- 
mann, “Wissen und Begriinden: Evidenz als umkampfte Ressource in der 
Wissensgesellschaft. Einleitung”, in Wissen und Begriinden: Evidenz als 
umkämpfte Ressource in der Wissensgesellschaft, eds. Karin Zachmann 
and Sarah Ehlers (Baden-Baden: Nomos, 2019): 27. 

Own translation of the quote by the authors. Andreas Wenninger, Fabi- 
enne Will, Sascha Dickel, Sabine Maasen, and Helmuth Trischler, “Ein- 
und Ausschließen: Evidenzpraktiken in der Anthropozändebatte und der 
Citizen Science”, in Wissen und Begründen: Evidenz als umkämpfte Res- 
source in der Wissensgesellschaft, eds. Karin Zachmann and Sarah Ehlers 
(Baden-Baden: Nomos, 2019): 54. 

Vohland, Weißpflug and Pettibone, “Citizen Science and the Neoliberal 
Transformation of Science”, 3. 

On the notion of socially robust knowledge, Helga Nowotny, Peter Scott, and 
Michael Gibbons, Wissenschaft neu denken: Wissen und Öffentlichkeit 
in einem Zeitalter der Ungewißheit (Weilerswist: Wellbrück, 2004), 149. 
Federal Ministry of Education and Research’s Communication on the 
Sustainable Integration of Citizen Science into the Science System, 
accessed February 4, 2022, https://www.bmbf.de/bmbf/shareddocs/ 
pressemitteilungen/de/karliczek-wir-wollen-die-buerg-wissenschaftssystem- 
verankern.html. 

ECSA (European Citizen Science Association), “Ten Principles of Citizen 
Science”, Berlin, 2015, 1. Accessed November 22, 2022, http://doi.org/ 
10.17605/OSF.IO/XPR2N. 

See Thomas F. Gieryn, “Boundary-Work and the Demarcation of Science 
from Non-Science: Strains and Interests in Professional Ideologies of Sci- 
entists”, American Sociological Review 48, no. 6 (1983), 789. Moreover, 
see Thomas F. Gieryn, Cultural Boundaries of Science. Credibility on the 
Line (Chicago: Univ. of Chicago Press, 1999). 

One of the significant representatives of the British line of citizen science is 
the sociologist Alan Irwin; see Alan Irwin, Citizen Science. A Study of Peo- 
ple, Expertise, and Sustainable Development (London: Routledge, 1995). 
See Caren B. Cooper and Bruce V. Lewenstein, “Two Meanings of Citizen 
Science”, in The Rightful Place of Science: Citizen Science, a series by the 
Consortium for Science, Policy & Outcomes (Arizona State: Univ. Press, 
2016), 51-62. 

See Gwen Ottinger, “Reconstructing or Reproducing? Scientific Authority 
and Models of Change in Two Traditions of Citizen Science”, in The Rout- 
ledge Handbook of the Political Economy of Science (London: Taylor and 
Francis, 2017), 351-363, here 351. 

Among other typification approaches, we refer to the typology of project mod- 
els of participation in scientific research by Jennifer L. Shirk, Heidi L. Ballard, 
Candie C. Wilderman, Tina Phillips, Andrea Wiggins, Rebecca Jordan, and 
Ellen McCallie, “Public Participation in Scientific Research: A Framework for 
Deliberative Design”, Ecology and Society 17, no. 2 (2012): Art. 29. Shirk 
et al., “Public Participation” also list a fifth model of participation, contrac- 
tual projects, which are designed for laypeople to commission professional 
research to investigate specific topics for them. Although we do not list this 
model here as part of potentially epistemic participation, this model should 


272 


23 


24 


25 


26 


27 


28 


29 


30 
31 


32 


37 


38 


Kevin Altmann and Andreas Wenninger 


not be unmentioned. An early typology of modes comes from Bonney et al., 
see Rick Bonney, Heidi Ballard, Rebecca Jordan, Ellen McCallie, Tina Phil- 
lips, Jennifer Shirk, and Candie C. Wilderman, Public Participation in Sci- 
entific Research: Defining the Field and Assessing its Potential for Informal 
Science Education. A CAISE Inquiry Group Report (Washington: Center 
for Advancement of Informal Science Education (CAISE), 2009). 

Lisa Pettibone, Katrin Vohland, and David Ziegler, “Understanding the 
(Inter)Disciplinary and Institutional Diversity of Citizen Science: A Survey of 
Current Practice in Germany and Austria”, PLoS One 12, no. 6 (2017): 1-16. 
Bruno J. Strasser, Jerome Baudry, Dana Mahr, Gabriela Sanchez, and 
Elise Tancoigne, “‘Citizen Science’? Rethinking Science and Public Partic- 
ipation”, Science & Technology Studies 32, no. 2 (2019): 64. 

David Silverman, Interpreting Qualitative Data (London: SAGE, 2014). 
“Against Citizen Science”, accessed 11/23/2021, https://aeon.co/essays/ 
is-grassroots-citizen-science-a-front-for-big-business. 

Vohland, Weißpflug, and Pettibone, “Citizen Science and the Neoliberal 
Transformation of Science”, 1. 

Vohland, Weißpflug, and Pettibone, “Citizen Science and the Neoliberal 
Transformation of Science”, 3. 

Dick Kasperowski and Thomas Hillman, “The Epistemic Culture in an 
Online Citizen Science Project: Programs, Antiprograms and Epistemic 
Subjects”, Social Studies of Science, Vol. 48, no. 4 (2018): 564-588. 
Christopher Kullenberg and Dick Kasperowski, “What Is Citizen Science? — 
A Scientometric Meta-Analysis”, PLoS One 11, no. 1 (2016): 1-16. 

See Strasser et al., “Citizen Science’? Rethinking Science and Public Par- 
ticipation”, Science & Technology Studies 32, no. 2 (2019), 52-76. 
Following Park and Burgess, we understand assimilation as the latent pro- 
cess of structural subordination of foreign actors into the dominant com- 
munity of the field, whereby internal conflicts are regulated and finally 
accommodated as the creation of a common basis of interests. For the 
case of assimilative citizen science, we observe similar processes in which 
participatory efforts are (smoothly) absorbed into the scientific field struc- 
tures, so that citizen science can no longer be clearly distinguished from 
professionalized research, but itself becomes an integral part of the field 
and its practices. See Robert E. Park and Ernest W. Burgess, Introduc- 
tion to the Science of Sociology: Including an Index to Basic Sociological 
Concepts (Chicago: Univ. of Chicago Press, 1969). On the migration soci- 
ological concept of assimilation, see further Milton M. Gordon, Assimila- 
tion in American Life. The Role of Race, Religion, and National Origins 
(New York: Oxford Univ. Press, 1964). 

It should be noted that various control mechanisms are also found in 
the citizen initiatives, but these controls are not guided by professional 
researchers to evaluate scientificity. 

See for example Bonney et al., Public Participation in Scientific Research, 11. 
Hecker, Garbe, and Bonn, “The European Citizen Science Landscape”, 194. 
On the differentiation of invited and uninvited participation in science, see 
Brian Wynne, “Public Participation in Science and Technology: Perform- 
ing and Obscuring a Political-Conceptual Category Mistake”, East Asian 
Science, Technology and Society 1 (2007): 99-110. 

Vohland, Weißpflug, and Pettibone, “Citizen Science and the Neoliberal 
Transformation of Science”, 2. 

In Shirk et al., “Public Participation”, collegiate essentially refers to ama- 
teur researchers working individually who have little or no contact with 
certified experts in the process of their research. However, in a few rare 


39 


40 


41 


42 


43 


44 
45 


46 


47 


48 


49 


50 


51 


Participation as Evidence Contestation 273 
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10 Exploring Consumers’ Interpretation 
of Contested Nutritional Evidence 


The Relevance of the Moral 
Foundations Theory 


Edoardo Maria Pelli and Jutta Roosen 


In 1977, the Select Committee on Nutrition and Human Needs to 
the United States Senate published the Dietary Goals for the United 
States.! In its recommendation to limit the consumption of red meat 
and dairy products, it was met with controversy by the food indus- 
try. Changes in those goals reduced the dietary recommendation to 
the level of nutrient composition of energy intake, that then rec- 
ommended how much energy was to be taken from carbohydrates, 
sugars, fat and protein. Dietary Goals was followed by The Surgeon 
General’s Report on Nutrition and Health,” which recognized the 
relationship between nutritional problems and overconsumption as 
well as imbalances of dietary intake. What had been a problem of 
scarcity before World War II had become an issue of food affluence 
by the 1970s.° This presented a major shift from addressing deficien- 
cies in single nutrients.* The resulting changes in nutrition recom- 
mendations illustrate well why exploring consumers’ interpretation 
of nutritional evidence is relevant. It still holds true that variations 
in nutritional needs between different people make it impossible to 
define simple nutritional standards. Recommended daily allowances 
can be calculated for different population groups but have limited 
effectiveness in terms of guiding consumers’ food choices. 
Nutritional sciences are a relatively young scientific discipline. 
While dietetic nutrition knowledge existed in ancient Greece in the 
form of nutrition guidelines for a good life, a natural science based 
approach to nutrition only emerged in the 19% century.° At that time, 
food security and safety were the focus of concern. The primary pre- 
occupation was with the provision of sufficient energy, considered not 
only the foundation of life but also a means of avoiding social unrest.’ 
Over time, scientific advances made it possible to describe nutrition 
in more refined terms, focusing not only on energy but also on the 
supply of various nutrients. For example, the first vitamin was scientif- 
ically described less than a century ago in 1926.° Until approximately 
the 1990s, nutritional science research and recommendations were 
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devoted to identifying key nutrients (such as vitamins, carbohydrates, 
fats) and the specific effect of single nutrients on human health.” The 
consequence of this was that governments developed the recommended 
dietary allowances for each nutrient, advising a minimum intake of 
“good” nutrients (such as vitamins, minerals and proteins) and reduc- 
tion of “bad” nutrients (mostly fats and sugars).!° However, the sci- 
entific evidence and efficacy of this approach has been contested since 
the 1980s, when it was discovered that the effects on human health 
may be determined less by single nutrients than by the complexity of 
dietary patterns. This led to the development of nutrition pyramids, 
as developed in the United States and Germany.!! This gradual shift 
in scientific knowledge shows that the evidence in the field of nutri- 
tional sciences is still controversial, as evident in the ongoing debates 
among scientists on the possible relationships among foods, nutrients 
and human health.'? 

In fact, results from studies supporting these new approaches have 
become available only recently, and many scientists criticize the rela- 
tively weak evidence existing between nutrition and health as it refers to 
single foods or nutrients.'? Part of the debate among the scientific com- 
munity originates from the fact that randomized control trials (RCTs) 
are often considered the highest source of scientific evidence in the con- 
text of evidence-based medicine.'* Therefore, the quality of nutritional 
studies is often evaluated with tools that confine the concept of quality 
within the realm of RCTs. However, RCTs are not always suitable or 
possible. While RCTs are easier to conduct when assessing the short- 
term effects of nutrients on human health,' they are not appropriate 
when establishing the long-term and lifestyle effects of nutrients, for 
practical, ethical and methodological reasons.'* This is why evidence 
for the latter is based on observational and cohort studies.!” In order 
to study the issue of nutritional evidence, it is important to recognize 
both the complexity and controversy involved. As is often the case at 
the scientific frontier, established scientific knowledge is thrown into 
question by new research results. Furthermore, nutritional evidence 
is a contested issue because the food industries provide substantial 
funding for nutritional research to universities and to nutritional and 
health institutions, leading to conflicts of interest and the so-called 
funding effect.'® This effect relates to the risk that scientific studies 
funded by the food industry tend to lead to results that support the 
sponsors’ interests. 

The complexity and ambiguity in the field of nutritional sciences 
creates confusion among consumers, also because the simple provi- 
sion of evidence on what constitutes healthy eating seems insufficient 
to convince them to change their current behaviors.'? The behavioral 
impact of nutrition advice remains limited although findings from the 
nutritional sciences receive a lot of public attention and media coverage, 
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where the contested nature of nutritional evidence is also a factor prop- 
agating the confusion among consumers. Nutritional information is 
often sourced from incomplete and contradictory scientific studies.2 In 
fact, the media often report results from contradictory studies that link 
several types of foods to specific health effects, such as the controver- 
sial debate regarding the possible relationship between consuming (red) 
meat and developing cancer in recent years. Furthermore, newspapers 
are under pressure to maximize their readership while journalists often 
do not have the time and the scientific skills to evaluate scientific stud- 
ies critically.?! 

Given that nutritional evidence is in trouble, the objective of this 
essay is to develop a conceptual framework to study how consumers 
deal with contested nutritional evidence. We refer to consumers as inde- 
pendent individuals that build their own evidence practices regarding 
food and nutrition. As such, they are users but not passive recipients 
of scientific evidence. The maintained hypothesis of our theoretical 
reasoning is that evidence in the field of nutrition is controversial and 
contested for many reasons, and it may therefore be difficult for con- 
sumers to base their views regarding their eating behavior on scientific 
evidence alone. Our hypothesis is that consumers form their attitudes 
toward nutritional evidence not fully rationally on scientific evidence 
and knowledge, but that this process is influenced by non-epistemic 
values through heuristic information processes. In this context, psy- 
chological approaches can be useful in developing the conceptual 
framework and deriving testable hypotheses. Our approach identifies 
one specific category of values following the moral foundations the- 
ory (MFT). The theory assumes that intuitive judgments guide the 
evaluation of objects and behavior, which we hold to be applicable in 
the context of consumers’ food decision-making. These decisions and 
evaluations often occur in low involvement situations so that an intui- 
tive approach seems particularly useful. This chapter develops a moral 
foundation approach to study consumers’ interpretation of contested 
nutritional evidence. We present a theoretical exploration of consum- 
ers’ interpretation of contested nutritional evidence, highlighting the 
importance of MFT as part of this process. We introduce an example 
where nutritional evidence is contested: Namely the phenomenon of 
the so-called superfoods. Here we show that from a theoretical per- 
spective, considering the difficulty of basing their views on nutritional 
evidence, consumers may not judge the nutritional aspects of foods 
completely rationally, as suggested by neoclassical economic mod- 
els. We therefore propose that individuals base their perceptions of 
nutritional aspects of foods on more intuitive and heuristic processes, 
largely driven by moral values. In this context, we explore the MFT 
and demonstrate in-depth how this theory fits into our theoretical 
framework. We do so via a series of four theoretical examples. Finally, 
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we summarize our theoretical framework and explain how the issue 
of contested nutritional evidence relates to the wider discussion on 
contested evidence in this volume. 


The Contested Nutritional Evidence for Superfoods 


The current marketing trend for the so-called superfoods is espe- 
cially characterized by contested nutritional evidence. Superfood is 
a marketing term used to promote several foods for their presumed 
exceptional nutritional characteristics and benefits for health, despite 
lacking and/or controversial scientific evidence.”° Superfoods are 
mostly exotic fresh produce coming from the Global South and also 
consumed in the Global North, where they represent a current impor- 
tant marketing trend,?* although there is legally no regulated defi- 
nition of the term superfoods worldwide.” Prime examples of these 
superfoods include, among others, avocado, quinoa, chia seeds, acai 
berries, goji berries and maca root. These superfoods, which for cen- 
turies were consumed only by the local communities in the Global 
South, have recently been in increasing demand among consumers in 
the Global North.” Studies that have measured the health benefits of 
superfoods (considered by Joseph Bassaganya-Riera et al. as belong- 
ing to the broad category of functional foods) often have limited evi- 
dence from human trials.” Bassaganya-Riera et al. remark that it is 
important to have complementary studies on humans, that is both 
interventional RCTs and observational nutritional epidemiological 
studies. This need for complementarity is confirmed also by David L. 
Katz et al.,?8 who showed that the “relative primacy in adjudicating 
medical evidence” often attributed to RCTs does not always represent 
the case. As mentioned in the introduction, while for studies on short- 
term effects of nutrients on human health RCTs are easier to conduct, 
for studies on long-term and lifestyle effects of nutrients on human 
health RCTs are not applicable. In these latter cases, observational 
nutritional epidemiology is necessary. Taking this general argument 
back to our specific case of superfoods, we can infer that the com- 
plementarity of evidence is urgently needed. To measure a short-term 
effect of superfoods on health (e.g. the reduction in cholesterol level by 
the healthy fatty acids contained in avocado), a RCT would be appli- 
cable. However, to establish a long-term effect (e.g. the relationship 
between avocado consumption and the prevention on the development 
of several non-communicable diseases), a RCT would not be appro- 
priate and observational nutritional epidemiology would be needed. 
However, evidence coming from complementary approaches to human 
studies is lacking, and this underlines the contested and controversial 
nature of nutritional evidence with regard to superfoods and health. 
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Avocado is held to possess numerous nutritional and health benefits, 
such as antioxidant capacities.”” Acai? and goji berries’! are also said 
to possess high levels of antioxidants. Regarding chia seeds and quinoa, 
their presumed health benefits are due to the high level of proteins. Last 
but not least, maca root is considered beneficial for health due to its high 
levels of vitamins and minerals.** However, as mentioned previously, 
the scientific evidence for the nutritional and health benefits of these 
so-called superfoods is generally still limited and contested. 

Furthermore, despite the presumed nutritional benefits, the consump- 
tion of superfoods is linked to several environmental and socio-economic 
issues. A prime example is the case of avocado, which has become a very 
trendy superfood worldwide. In Mexico, the main producing country, 
avocado production has led to the problem of severe water depletion.’ 
Even beyond Mexico, a study considering global avocado production in 
2018 indicated that: “Globally, around 6.96 km? of water is used or the 
equivalent of around 2.82 million Olympic size swimming pools (assum- 
ing a volume of 2500 m? each) for avocado production in 2018”.34 In 
addition, avocado production has several socio-economic consequences. 
For example, as more land is devoted to avocado production for export, 
food insecurity has risen in some regions of Mexico. Stimulated by the 
increasing international demand, avocado production often replaces 
subsistence crops. These socio-economic and environmental aspects of 
superfoods are not only related to the primary production and the envi- 
ronment but also have ethical implications across the agri-food supply 
chain: consumers at the end of the chain may have strong concerns about 
the harm done to the environment and producers in the Global South. 

Another example related to the possible negative environmental 
impact is the case of quinoa produced in the coastal area of Peru. 
Here the use of pesticides has intensified together with the expan- 
sion of quinoa production. The rise of pesticide use may hamper 
Peruvian quinoa’s export to the Global North, due to possible lacks 
in meeting the requirements of international pesticide residue lim- 
its.35 The situation exemplifies the fact that the controversy around 
excess/inappropriate pesticide use in the Global South is still present 
today, even if the major controversy on this issue took place in the 
1970s-1980s, as described in Chapter 8 of this volume. The concern 
over the excessive use of pesticides in the Global South among envi- 
ronmentalists was a critique of previous established scientific evidence, 
which justified the use of pesticides for economic and agricultural pro- 
ductivity reasons. These concerns were expressed in scientific argu- 
ments together with their moral implications. In the case of quinoa, 
the excessive use of pesticides in the Global South demonstrates that 
even nowadays the environmental evidence regarding some super- 
foods may be contested and may provoke moral concerns. In fact, 
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nowadays consumers in the Global North may feel ethical concerns 
about the negative conditions of the environment related to their 
consumption choices and the negative implications for the popu- 
lations in the Global South living in areas where these products are 
cultivated. 

Another feature that makes superfoods a very interesting case study 
for contested nutritional evidence relates to the fact that superfoods are 
heavily promoted in the media for their presumed nutritional and health 
benefits. One of the extreme examples of this phenomenon is the promo- 
tion of the nutritional and health benefits of some superfoods (such as 
acai berries) by the famous TV-host Oprah Winfrey.3* This advancement 
of superfoods by influencers and the media not only has marketing but 
also ethical implications for promoters and consumers. With influencers 
and media providing incomplete and inaccurate information, consumers 
may perceive the misinformation as unfair and misleading. 

Given all these multiple facets, we explore consumers’ interpreta- 
tion of contested nutritional evidence using the example of superfoods. 
Nutritional evidence is contested, and neither actors in public policy 
making nor individual consumers can rely on a strong evidence base for 
their decision-making. 


The Need for Psychological Approaches to Study Consumers’ 
Interpretation of Contested Nutritional Evidence 


To explore theoretical approaches for studying consumers’ interpreta- 
tion of contested nutritional evidence, it is important to define the con- 
cepts of consumer beliefs and consumer attitude. A consumer belief 
about an object can be defined as the perceived probability that an object 
is associated with another concept. For example, a possible belief is that 
superfoods (the object) are healthy (the other concept). Furthermore, 
the cognitive, affective and behavioral consumer interpretation of an 
object is considered in relation to a consumer’s attitude. According to the 
multi-attribute attitude model, the consumer attitude about an object 
can be defined as a function of all consumer beliefs about the object and 
the evaluative aspects of those beliefs. Mathematically it is possible to 
define a consumer attitude toward an object as: 


N 
È paa 
i=1 


B, = belief “i” about the object, 
a; = evaluative aspects of B; 
N = the number of beliefs.?7 


Contested Nutritional Evidence 287 


Further research on the concept of beliefs was developed in the context 
of the means-end-chain theory. This theory assumes that beliefs are 
part of a hierarchical evaluation and relate the object of evaluation to 
a chain of other concepts, i.e. attributes, consequences and values.3% 
In their empirical study on beliefs, Klaus G. Grunert and Tino Bech- 
Larsen presented a framework linking the concepts of beliefs, means- 
end-chain theory and the choice option attractiveness, where the latter 
can be considered a synonym of attitude.*? The research aim of their 
study was to understand empirically whether the attractiveness of or 
the attitude toward a choice option can be explained by attributes only, 
or whether beliefs linking the choice attributes to consequences and 
values improve their explanatory power. From the results of this study, 
obtained through a specific methodological procedure (the laddering 
method), the authors write: “We have concluded that beliefs linking the 
product to constructs of higher levels of abstraction — consequences and 
values - improve the explanation of choice option attractiveness beyond 
the explanation achieved by beliefs linking the product to attributes 
only”.4° These results are in line with the results of a previous empir- 
ical study, obtained through the same methodological procedure.*! It 
indicated that values had significant explanatory power in explaining 
product preference beyond the explanatory power provided only by 
attributes and consequences. The term used in this study, namely prod- 
uct preference, could be considered a synonym of product acceptance. 
In conclusion, both empirical studies suggest that values linked to a 
product may be very important because they explain how the concrete 
attributes of a product influence consumers’ beliefs and consequently 
attitudes and finally determine consumer acceptance or non-acceptance 
of the product. This insight is especially relevant in our research con- 
text because the nutritional evidence of superfoods is scarce and con- 
sequently it is difficult for consumers to judge the scientific nutritional 
attributes of superfoods. Consumers may interpret the superfoods and 
form their beliefs not fully rationally based on scientific attributes 
and their consequences but founded on abstract values linked to these 
attributes through heuristic information processes. 

The strictly economic rational model grounded in neoclassical eco- 
nomics, where the consumer tries to maximize utility through a strictly 
rational judgment of the quality aspects of food products, is not suf- 
ficient to study the topic of consumers’ attitudes toward nutritional 
evidence for superfoods. Instead, a psychological model is needed that 
takes into account consumer strategies for dealing with incomplete 
knowledge such as heuristic information processing and values.* This 
entails the following questions: Which type of psychological model 
would be appropriate? Which kinds of values may be more appropriate 
to explain, through heuristic information processes, consumers’ beliefs 
and consequently attitudes and acceptance with regard to the nutritional 
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evidence of superfoods? We provide answers to these questions in the 
next section. 


The Contribution of the Moral Foundations Theory to Investigating 
Consumers’ Interpretation of Contested Nutritional Evidence 


Moral values can be important moderators in explaining consumer 
beliefs, and consequently attitudes and acceptance or non-acceptance 
with regard to the nutritional evidence for foods, through heuristic 
information processes. In fact, in this context of uncertainty around the 
nutritional aspects of foods, several types of foods are often considered 
“good foods for health” or “bad foods for health”, and these definitions 
may have a strong moral connotation. Furthermore, superfoods are often 
perceived as “good foods for health” even if consumers lack the specific 
nutritional knowledge of superfoods to make such judgments. Moreover, 
previous literature suggests that the attribute “healthy” (which, accord- 
ing to us, is the main characteristic attributed to superfoods) implicitly 
hints at specific discourses of the “submerged iceberg of moral values”.* 

We conjecture that moral values can act as moderators for inter- 
preting scientific knowledge and we consider MFT as a promising and 
comprehensive psychological theory that is appropriate to studying con- 
sumers’ interpretation of nutritional evidence. The first instantiations 
of MFT go back to Jonathan Haidt** and Haidt and Jesse Graham.% 
We introduce the theory here as described by Graham et al.46 MFT was 
developed to give an answer to the question of the origins of morality. 
The authors ask: “Where does morality come from? Why are moral 
judgments often so similar across cultures, yet sometimes so variable? 
Is morality one thing, or many? MFT was created to answer these ques- 
tions”.*7 Of course, MFT was born in the context of an earlier exten- 
sive and significant literature on moral development as summarized in 
Graham et al. The development of modern moral psychology started 
from the work of Lawrence Kohlberg, who assumed that there was only 
one moral foundation, namely the concept of justice. Kohlberg has thus 
been considered a monist moral psychologist. Carol Gilligan later crit- 
icized Kohlberg on the grounds that women’s morality presents two 
moral values, i.e. not only the concept of justice but also the concept 
of care. Kohlberg accepted Gilligan’s view and this dualistic approach 
(justice and care) has gained general consent among moral psycholo- 
gists, e.g. Elliot Turiel. The assumption that morality relates only to 
individuals and how individuals establish relationships between one 
another was challenged by Richard A. Shweder, who supported the idea 
of a broader pluralism, using the example of a non-western culture, i.e. 
India, where it was evident that morality relates not only to individuals 
but also to collective phenomena such as groups, organizations, rules 
and cultural inheritances and religious beliefs. Shweder introduced the 
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idea that across cultures human beings are constituted by three moral 
aspects: Autonomy (which refers to moral characteristics such as care 
and justice), community (which refers to moral characteristics such as 
loyalty, obligation and respect) and divinity (which refers to spiritual 
and moral characteristics such as purity and sanctity). In relation to 
this categorization of explicit moral discourse by Shweder, Alan P. Fiske 
claimed that moral evaluations were based on four relational models: 
“Communal Sharing, Authority Ranking, Equality Matching, and 
Market Pricing”. Jonathan Haidt (one of the authors of MFT) tried to 
combine the theories of Shweder and Fiske but it was difficult to merge 
two different perspectives (the manifestly moral discourse of Shweder 
and the concept of interpersonal relationships in Fiske). Jonathan Haidt 
(along with his colleague Craig Joseph) set out to construct a more com- 
prehensive theory. 

Taking a pluralistic approach, Haidt and the other authors of MFT 
asked themselves: How many basic elements of morality can be identified 
and what are these basic elements of morality?* To elaborate the answer 
to this question, the authors interestingly used the metaphor of food taste: 


The human tongue has five discrete taste receptors (for sweet, sour, 
salt, bitter, and umami). Cultures vary enormously in their cuisines, 
which are cultural constructions shaped by historical events, yet the 
world’s many cuisines must ultimately please tongues equipped with 
just five innate and universal taste receptors. What are the best can- 
didates for being the innate and universal ‘moral taste receptors’ 
upon which the world’s many cultures construct their moral cui- 
sines? What are the concerns, perceptions, and emotional reactions 
that consistently turn up in moral codes around the world, and for 
which there are already-existing evolutionary explanations?” 


As an answer to this metaphorical question, the authors identified five 
basic elements of morality or five moral values, which they defined as the 
five moral foundations: Care/harm; fairness/cheating; loyalty/betrayal; 
authority/subversion; purity/sanctity/degradation. 

Care/harm refers to the preoccupation with taking care of others or for 
feeling compassion for people who have been caused harm. The authors 
give the example of mothers (not only humans but also other mammals) 
who are very concerned to take care of and nurture their offspring. 
Another example given by the authors is the compassion for victims. 
Fairness/cheating relates to the feeling of being honest or dishonest with 
other people. An example would be the perceived accuracy of media in 
reporting news. Readers may feel that the media are fair and report the 
news accurately, or that the media are cheating and they report false 
news, perhaps because of a conflict of interests. Loyalty/betrayal refers 
to the level of loyalty between individuals. An example would be a loyal 
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friend who helps you when needed, while a disloyal friend does not. 
Authority/subversion refers to the obedience or disobedience to author- 
ity. An example could be citizens who trust and obey legislators who 
make the laws and citizens who do not obey the laws. Purity/sanctity/ 
degradation refers to feelings of delight or disgust. An example could be 
a delight with foods that are perceived as nutritious and safe, and disgust 
for foods that are perceived as unhealthy and unsafe (e.g. contaminated 
by pathogens). 

Let us now briefly examine the assumptions that sustain this theory 
and the development of the moral foundations. Firstly, these foundations 
are considered to be innate in the “first draft of the moral mind”,5 con- 
ceived and organized in advance of experience. However, despite this 
nativist approach, the authors believe that they are shaped differently 
for each individual according to their different experiences and cultural 
learnings, and through the process of cultural development. 

Another important aspect that characterizes the moral foundations, 
as conceived by the authors, relates to the concept of intuitionism. Moral 
judgments (motivated through the moral foundations) happen quickly 
and intuitively, while the moral reasoning comes after the moral judg- 
ment, as a support and a justification for the moral judgment. This con- 
cept was developed through the social intuitionism model (SIM).5! We 
will come back to this concept later when we show how these concepts 
relate to our conceptual framework explaining consumers’ judgment of 
superfoods. 

Furthermore, Graham, Haidt and their collaborators have always 
welcomed the possibility that the moral values could exceed five, being 
open to any update and testing of the theory. In fact, many methods 
have been developed to test MFT. The concepts have been developed 
in a method-theory coevolution: The theory can inspire new methods 
to test the theory, while at the same time the results from the applica- 
tion of methods can inspire the further development of the theory itself. 
Furthermore, this theory has been applied within the field of social psy- 
chology. The authors claim that it should also be applied beyond this 
field and there have indeed been such applications. In fact, the authors 
believe that MFT is a practical theory that may prove useful in many 
fields. This theory is thus in perpetual evolution, to be updated and in 
development, and thus particularly suitable for research that is highly 
cross-disciplinary. 

We believe that our conceptual model, which crosses different dis- 
ciplines, i.e. economics, psychology as well as food and nutritional 
sciences, can contribute on updating and developing the theory. In fact, 
our application of MFT to food consumption and particularly nutri- 
tional evidence covers a new area. Moreover, although it is a relatively 
new field, there have been already very interesting empirical applications 
of MFT to food consumption. Given the importance of these empirical 
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applications of MFT to food consumption, we briefly review some of 
those studies here. 

One study found that respondents with stronger agreements on care 
and fairness statements were more likely to purchase environmentally 
sustainable dairy products and pork from swine raised with limited anti- 
biotic usage. They were also more inclined to vote for stricter livestock 
environmental standards and disease protocols.*? Another study found 
that the agreement with care was positively correlated with the likeli- 
hood of being vegetarian rather than flexitarian, while the agreement 
with authority was positively correlated with the likelihood of being a 
full-time meat eater rather than a flexitarian.s* Furthermore, another 
study revealed that the importance of the moral value of purity mediated 
a positive relationship between religiosity and diet-minded food con- 
sumption, which can be considered a diet based on foods free from fats, 
sugars or allergens.°* 

Although these studies apply MFT to the study of consumers’ atti- 
tudes toward food consumption, the relationship between MFT and 
nutritional evidence has not yet been fully investigated with the explicit 
acknowledgment that nutritional evidence is a contested issue. We 
therefore develop a conceptual framework to explain how the MFT 
can contribute to understanding consumers’ attitudes toward contested 
nutritional evidence using the example of the superfoods. Our concep- 
tual framework is displayed in Figure 10.1. 

As we can see from Figure 10.1, our theoretical assumptions consist 
in the following process: Consumers have scarce knowledge about the 
scientific nutritional attributes of superfoods because the nutritional evi- 
dence for superfoods is limited and controversial and consumers lack 
the expertise to judge the nutritional properties. Given this scarce know- 
ledge, consumers form their beliefs and consequently their attitudes and 
acceptance of the nutritional evidence for superfoods through a heuris- 
tic information process moderated by the moral values that consumers 
hold. This means that consumers base their beliefs and consequently 
attitudes and acceptance or non-acceptance of superfoods by relying on 


Moral 
foundations/values 


Scarce knowledge on nutritional attributes Heuristic information process Consumer beliefs and beliefs’ evaluation ~ 
of superfoods attitude and acceptance 


Figure 10.1 Conceptual framework. Figure by Edoardo Maria Pelli and Jutta 
Roosen. 
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moral values linked to superfoods rather than on scientific nutritional 
attributes and information. 

MFT is particularly suited to studying consumers’ attitudes toward 
nutritional evidence of superfoods. In fact, foods promoted as healthy 
are generally perceived to have strong moral connotation, e.g. “good 
foods” which are free from “bad nutrients or additives”. In addition, 
previous literature suggests that the attribute “healthy” implies specific 
discourses about moral values.s 

These moral values somehow substitute the needs of consumers for 
nutritional evidence in order to form their attitudes. Therefore, consum- 
ers bypass the issue of nutritional evidence by referring to moral val- 
ues. As such, consumers are not actively engaging in evidence critique 
by questioning specific methods and results in the nutritional sciences. 
Rather, they are developing their own intuitive judgments about the ben- 
efits of foods. By doing so, they participate in the de-stabilization of 
the evidence at the interface of science and public. At the same time, 
consumers use these intuitive judgments to re-stabilize their everyday 
practices in the face of contested nutritional evidence. 

We now present two more possible examples of how consumers’ beliefs 
(and consequently attitudes and acceptance) with regard to the nutri- 
tional evidence of superfoods may be moderated by specific moral values 
as defined by MFT. The first example, displayed in Figure 10.2, relates 
to how consumers may form their beliefs (and consequently attitude and 
acceptance) with regard to the presumed healthiness of superfoods. 

We can interpret Figure 10.2 as follows: Superfoods are presented as 
healthy to consumers, who cannot judge this attribute “healthy” because 


Superfoods promoted as healthy may be perceived by consumers as pure, 
uncontaminated by “bad” nutrients 


+ correlated with the importance of the moral 
foundation/value of Purity 


+ consumer acceptance of superfoods 


Figure 10.2 Possible relationship between the attribute: “healthy” and the 
moral foundations/values. Figure by Edoardo Maria Pelli and 
Jutta Roosen. 
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of the lack of sufficient nutritional knowledge and expertise. Therefore, 
consumers may accept this attribute “healthy” not based on its scientific 
meaning but based on the association to a concept of a “good” and 
“pure” food free from “bad nutrients”, which may be positively corre- 
lated to the importance of the moral foundation of purity/sanctity/deg- 
radation. Therefore, through a heuristic information perception process 
moderated by the moral foundation of purity/sanctity, consumers may 
form their beliefs and consequently attitudes toward and acceptance 
of superfoods. Namely, the more consumers are attached to the moral 
value of purity/sanctity, the more consumers may perceive and accept 
superfoods as healthy foods. 

The second example relates to the consumers’ trust on influencers who 
promote superfoods through the media and this example is displayed in 
Figure 10.3. The conceptual framework illustrated can be interpreted 
as follows. “Pseudo-scientific” authorities,°° such as influencers, may 
promote superfoods as healthy through the media and consumers may 
trust them. This trust may lead consumers to think that influencers are 
role-model authorities and there may be a positive correlation between 
trust and the moral foundation of authority. Therefore, through a heu- 
ristic information process moderated by the moral foundation of author- 
ity, consumers may form their beliefs about superfoods promoted as 
healthy by the influencers. The more consumers trust influencers and 
the more consumers are attached to the moral foundation of author- 
ity, the more consumers may perceive and accept superfoods as healthy 
foods. Furthermore, the correlation between authority and trust can be 


Superfoods promoted by influencers through the media may obtain consumer trust 


+ correlated with the importance of the moral 
foundation/value of Authority 


+ consumer acceptance of superfoods 


Figure 10.3 Possible relationship between the specific role of communication of 
some influencers and moral foundations/values. Figure by Edoardo 
Maria Pelli and Jutta Roosen. 
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observed in the previous literature, where authority, even though not 
addressed specifically within the MFT, is linked to the recommenda- 
tions of role models (influencers).57 The meaning of the term influencer 
as part of the role of authority may itself imply that influencers are able 
to sway consumer decisions because consumers trust them. 

After these examples, we want to discover in more detail why the MFT 
is very suited for our conceptual framework. Our conceptual framework 
is based on the idea that, given that the nutritional evidence for super- 
foods is scarce, consumers form their beliefs and consequently their atti- 
tudes and acceptance or non-acceptance of superfoods not completely 
rationally based on scientific attributes, but by the moderation of moral 
values linked to superfoods, through a heuristic information process. 
The authors of MFT explicitly state that moral values are activated intu- 
itively and based on heuristic information processes, rather than evoked 
rationally. The theory explains this through the development of the SIM: 


the sudden appearance in consciousness, or at the fringe of con- 
sciousness, of an evaluative feeling (like-dislike, good—bad) about 
the character or actions of a person, without any conscious aware- 
ness of having gone through steps of search, weighing evidence, or 
inferring a conclusion.°® 


From this quote, we see that our conceptual framework perfectly fits 
with MFT, also because both MFT and our conceptual framework 
assume that moral judgments are intuitive and do not weigh the evi- 
dence in a computational manner. In our case, the nutritional evidence 
for superfoods cannot be weighted because it is contested and scarce 
and therefore difficult for consumers to assess. The moral foundations 
serve as a guideline to assessing the value of acceptability of superfoods. 
Moreover, in this quote, we can see that the explicit moral judgments 
are expressed through words such as “good” or “bad”, which are the 
ones also pertinent to our conceptual framework, such as “good food for 
health”. For these reasons, we think that the MFT contributes substan- 
tially to our conceptual framework. 

Lastly, MFT acknowledges the fact that cultural development plays 
a role in shaping the innate moral values of consumers, therefore we 
can extend our conceptual framework to include the concept of cultural 
development, as displayed in Figure 10.4. The conceptual framework 
displayed can be interpreted as follows. As in the previous conceptual 
framework (Figure 10.1), consumers, who have scarce knowledge of 
nutritional evidence and the scientific nutritional attributes of super- 
foods, form their beliefs and consequently their attitudes and acceptance 
or non-acceptance with regard to superfoods via the moderation of the 
moral values, through a heuristic information process. The difference in 
our new conceptual framework (Figure 10.4) is that the moderating role 
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Moral foundations/values 


Cultural development 


NL 


Scarce knowledge on nutritional attributes Heuristic information process Consumer beliefs and beliefs’ evaluation ~ 
of superfoods attitude and acceptance 


Figure 10.4 Extension of the conceptual framework through the role of cultural 
development. Figure by Edoardo Maria Pelli and Jutta Roosen. 


of moral values is shaped and affected by cultural development. Hence, 
cultural development also has a role in forming consumers’ beliefs and 
consequently attitudes and acceptance with regard to superfoods. For 
example, in a culture where environmental impact has a great impor- 
tance for consumers, this cultural attitude would reinforce the concept 
of care for the environment and therefore it could decrease consumers’ 
acceptance of superfoods, the production of which is associated with 
negative environmental impact. On the other hand, in a culture where 
environmental impact has not gained yet the attention of consumers, 
this cultural attitude would not reinforce the concept of care for the 
environment and therefore it would not decrease consumers’ acceptance 
of superfoods whose production has a negative environmental impact. 
With this last conceptual framework, we conclude our development of 
the theoretical approach. This theoretical development has shown that 
MFT can contribute substantially to the exploration of consumers’ atti- 
tudes toward contested nutritional evidence. 


Conclusion 


In this chapter, we have explored the role that MFT can play in attempts 
to explain consumers’ strategies with respect to “re-stabilizing” the 
contested nature of evidence coming from the nutritional sciences. By 
applying MFT to the study of consumers’ attitudes toward nutritional 
evidence about superfoods, it seems that we have served our theoretical 
hypothesis that consumers face scarce nutritional evidence. Therefore, 
their attitudes will not be based on scientific claims (of which consumers 
have scarce knowledge), but on heuristic information processes linked to 
moral values. Furthermore, we base our theoretical framework on the 
SIM developed by Haidt,* which posits that initial moral judgments are 
rather intuitive and driven more by heuristic than fully rational ones. 
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This volume is concerned with different situations in which scien- 
tific evidence is contested and therefore subjected to processes of de- 
stabilization and re-stabilization. Our case of nutritional evidence 
represents an interesting although slightly different aspect of these 
processes. Evidence in the field of nutrition is contested because corpo- 
rate funding may bias research® and methodological challenges lead 
to sometimes contradictory and conflicting results, thus increasing the 
confusion among the general public and consumers. Particularly for the 
case of superfoods, the health benefits conferred on these products are 
built on contradictory studies and often lack the evidence coming from 
human clinical trials.°' This phenomenon of controversial evidence is 
further amplified through the widespread and often inaccurate coverage 
and promotion of the presumed health benefits by the media, advertising 
and influencers.6% Therefore, consumers bridge the lack of nutritional 
evidence by using intuitive judgments based on moral values in order to 
form their beliefs, attitudes and acceptance of superfoods. 
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11 Stories about Villains, Mad 
Scientists and Failure 


Patterns of Evidence Criticism in Media 
Coverage of Genomic Research 


Susanne Kinnebrock and Helena Bilandzic 


Media coverage of science is double-edged. On the one hand, journalism 
is expected to cover science as objectively as possible: Science journalists 
should select new and important findings and present them correctly to 
their non-expert audiences. On the other hand, journalists are expected 
to transform findings and their evidence according to media logics 
and the common sense of a public at large.! As a result, complex scientific 
findings and evidencing practices become transformed into news stories 
that are supposed to be easy to understand and even entertaining.” 

The word “story” already indicates that the transformation of sci- 
entific findings into understandable news items is mainly a process of 
narrativization in which archetypical protagonists (e.g. villains or mad 
scientists) as well as archetypical plots (e.g. hero stories or stories of 
failure) are employed. Stories, or to use the scientific term, narratives, 
can be considered a common and efficient tool for conveying meaning.” 
We grow up listening to narratives such as fairy tales; we get to know 
typical storylines, archetypical protagonists and antagonists. Asa result, 
narratives are easily accessible and, not without reason, culturally and 
religiously formative texts are usually presented in a narrative form. 
Central mythological and religious records (e.g. the Iliad or the Bible) 
convey their moral messages in narratives.* 

Against this background, it is reasonable that journalism also uses 
narratives to inform audiences about scientific findings.’ However, an 
understandable and convincing story also offers a way to question the 
outcome of scientific research and to present problematic research. In 
this chapter, we analyze how news stories are used to question, criticize 
or even argue against scientific findings. For our analysis, we use media 
coverage of genomic research. We have chosen this field of research for 
several reasons, among them its importance for society and its rapid 
development. Additionally, genomic research receives considerable 
attention in the media. Not only is it a popular and controversial topic 
in news media whose coverage is full of hope and fear,® but it is also the 
subject of fictional narratives in novels and films. According to Rosalynn 
D. Haynes, who has analyzed recurring patterns in fiction about 
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science, it is especially narratives about genomic engineering that most 
often have recourse to stereotypes of scientists and criticisms of big busi- 
ness.” And, as we will demonstrate later, these features characterizing 
fiction about genetics can also be found in print coverage, which is to 
say, news tends to echo fiction when genomic research and its evidence 
is being criticized. 

We first outline our theoretical framework and locate science jour- 
nalism in the realm of science itself as well as journalism. In doing so, 
we focus on the strategies journalism usually uses to convey or even 
support scientific evidence. Since this chapter addresses the contrary — 
how coverage is used to weaken evidence — we focus our discussion on 
textual strategies employed to question and criticize evidence against the 
background of typical coverage of genomic research. Following this, we 
present a hermeneutic analysis of news stories, which reveals how jour- 
nalism contests scientific evidence using its own (non-scientific) devices 
and creates counter-narratives. We focus on five linguistic and culturally 
contextualized strategies, which we explain in detail. 


Theoretical Framework 


Practices of (Science) Journalism 


Publics seek to learn about scientific results to gain knowledge about 
technological, social and ecological developments that help to satisfy 
their curiosity about the future. Applications of scientific innovations 
(e.g. new medical treatments) may have a direct effect on their own lives. 
As laypersons, they usually do not have the access or expertise to inform 
themselves from genuine scientific sources. In this situation, journalism 
serves the function of mediating between science and the public and 
generating information that is understandable for the non-scientist.® 
Rather than merely dumbing down complex scientific content, journal- 
ists engage in a number of translations that gradually transform scien- 
tific content into a (re)construction for media presentation.’ 

In general, journalists’ (re)construction of reality follows certain rules. 
For example, news values such as focus on conflicts, catastrophes, elites 
or the emphasis on human action (= personalization) can be found in 
almost every media report. In terms of content, news values ensure the 
newsworthiness of media coverage and can be considered a recurring 
pattern.!0 These event-related patterns are complemented by conventions 
concerning the form of news reports. Journalism relies on a set of well- 
established formats (editorials, reports, glosses, etc.) whose characteris- 
tics are clearly defined and are usually respected - at least by professional 
journalists. For the most part, all these journalistic norms, content- as 
well as form-related, determine media representations. And, as Sharon 
Dunwoody demonstrates for the field of science journalism, science 
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journalists tend to adhere to journalistic norms to a greater extent than 
to scientific standards.!! 


Science Journalism and Second Level Evidencing Practices 


The adherence to journalistic norms is not surprising when comparing 
the basic systemic logics of journalism and science. Science strives for 
scientific validity. The function of journalism is to transform social real- 
ity in such a way that it becomes accessible to society (as media reality).'? 
Therefore, social reality is transmuted into generally understandable and 
preferably new topics. Science journalism deals with a specific part of 
social reality, i.e. science. It reports on new scientific findings, including 
the associated evidencing processes, and may also criticize them." This 
happens from an observational perspective because science journalists 
do not conduct their own studies; they do not produce scientific evi- 
dence in the narrow sense (this is mainly reserved to the science system). 
However, if “evidencing practices” are conceived of as the process of 
presenting, embedding and using evidence,! they also encompass tex- 
tual strategies to support a claim as evident (in the realm of science), or, 
true and valid (in the realm of journalism). 

Science journalism can describe scientific evidencing processes and, 
additionally, attribute evidence to certain findings linguistically, e.g. by 
emphasizing the quality of a study, the accuracy of its findings or its 
importance for further research. In a similar vein, science journalism 
can question the adequacy of evidencing processes or even allege fraud, 
e.g. by ascribing negative attributes to certain studies and methods or 
by using rhetorical strategies to discredit them. As a result, evidence 
deriving from science is either underlined or undermined by journalis- 
tic means. Thus, on an initial level, evidencing practices are located in 
science itself. But on a second level, journalism steps in and affirms or 
disconfirms evidence - resulting in what we call “second level evidencing 
practices” or “second level evidencing critiques”. These textual strategies 
should not be underestimated regarding their potential influence on pub- 
lic opinion and the repercussions on the science system. They can either 
support public knowledge and acceptance of scientific research, '5 or they 
can destabilize science by undermining faith in scientific research. There 
are quite a few historical examples where (critical) media discourse and 
public contestations of scientific evidence have affected public support 
for certain scientific fields — which can even result in restrictions on 
research.!* The repertoire of textual second level evidencing or criti- 
quing practices is large, as our analysis will show, and does not neces- 
sarily focus on scientific evidencing practices. News stories give context 
to scientific findings and evidencing procedures; they place research in 
a certain setting (which can be depicted as adequate or dubious), cre- 
ate characters (who can be described as moral, or untrustworthy and 
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even evil) and, in sum, often convey a moral message.! As a result, jour- 
nalistic critiquing practices in particular can focus on these contextual 
factors and simultaneously sow doubt about a scientific finding and evi- 
dencing processes. 


Evidencing Practices in Media Coverage 


In order to support a claim as true or valid, journalism has developed 
its own ways of substantiating scientific knowledge,'® which range from 
science-affiliated to journalism-savvy. Susanne Kinnebrock, Helena 
Bilandzic and Magdalena Klingler distinguish three textual strategies 
to underline the evidence of a finding.” First, the data and methods of a 
study can be presented in news reports to justify the study’s conclusions — 
which ultimately mirrors “evidencing practices”? common in the epis- 
temic culture of science and less typical of journalism.?! Second, experts, 
institutions or journals as renowned authorities in their specific research 
fields can be quoted.?? This evidencing practice is not only applied in sci- 
entific writing; quoting authorities as sources of information is also at the 
heart of news reporting. Quoting authorities and, in doing so, specifying 
their professional roles, affiliations and positions within institutions are 
well-established journalistic routines to underline the quality of a source 
and thereby the factuality of the information. As a result, references to 
authorities are equally common in the epistemic cultures of science and 
journalism. And third, evidence claims can be supported by telling a con- 
vincing story or narrative (e.g. of a successful healing process). 

Narratives are defined as a representation of events and characters.” 
Narratives are an everyday, natural mode of communication, widely used 
in science journalism because they turn scientific findings into equally 
understandable and tangible stories.”* At the same time, (science) jour- 
nalists can build on existing stories — on eternal stories or myths, as 
Jack Lule puts it” - to build on the audience’s prior knowledge. A brief 
reference to mythological stories like the tragic fall of Icarus or Victor 
Frankenstein’s incapability to control his creature can guide the reader’s 
interpretation of a current science story and its presumed end.*° As a 
result, the use of narratives can trigger different responses among the 
audience. Narratives can help to understand scientific evidencing proce- 
dures and thus strengthen the reader’s belief in scientific evidence claims. 
However, narratives can also distract the audience’s attention from the 
actual scientific point by emphasizing human interest. And additionally, 
a moral message is often conveyed, especially when news stories refer to 
myths.?” 

These three typical journalistic evidencing practices (data and meth- 
ods, authorities, narratives) also provide starting points for the analysis 
of evidence criticism in news media. The validity of data as well as mea- 
surement reliability can be doubted, authorities can be questioned or 
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even be unmasked as charlatans and, most of all, narratives can be used 
to refute the results of a study as a whole by providing counterexamples. 


Coverage of Genomic Research 


As with science coverage in general,?® coverage of genomics has increased 
over time.?? In the early 1990s - with Dolly, the cloned sheep, and geneti- 
cally modified food — genomic research received a lot of media attention. 
Topics like the human genome project, human stem cells and emerging 
fields such as synthetic biology or xenotransplantation were frequently 
covered.* Early studies showed that coverage of the emerging field of 
genomics was usually more positive than negative.*! Genetic engineer- 
ing in agriculture, however, can be regarded as an exception because 
news reports about this topic were more critical than news reports about 
genomics in general.’ In sum, the contextualization of “green” genetic 
engineering and “red” genetic technologies differs. Genetic engineering 
in agriculture is more often covered using a risk frame, genetic treat- 
ments in the field of medicine, however, tend to be reported using a 
progress frame.’ Even if media debates on genomic research are quite 
specific to national contexts, genomics has become an internationally 
relevant topic in science coverage, comprising heterogeneous evalua- 
tions,** which makes media coverage of genomics suitable for an analy- 
sis of second level evidence critique. 


Strategies of Evidence Criticism in Science Journalism 


As already outlined, the daily business of science journalists is reporting, 
not research. Therefore, they cannot reasonably be expected to provide 
scientific counter-evidence. They can, however, create critical news sto- 
ries. It is up to science journalists to craft their reports, i.e. they enjoy a 
great deal of freedom in choosing their topics and sources, which con- 
sequently affects the conclusions to be drawn from their reports.” To 
question the evidence of a specific finding, journalists can (1) rely on the 
description of other, alternative or “better” data and methods, (2) ques- 
tion the credibility of authorities and, instead, quote other, alternative or 
“better” experts and (3) tell compelling (human-interest) stories about 
the “victims” of science or “failed” research. 

In our analysis, we show that challenging the credibility of authorities is 
a common pattern of evidence criticism in journalism; the strategies used 
for this are personalization and negative stereotyping — strategies that 
resonate with fictional accounts of science and genetics.’ For lay audi- 
ences, especially criticism that focuses on scientists as people, on their 
actions and their morality (= personalization) is easier to understand 
than lengthy explanations as to why certain data and methods are prob- 
lematic. As a result, our analysis pays attention to those depicted as 
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dubious charlatans or mad scientists in conflict with groups of honorable 
scientists or even society as a whole. 

It is not only characters that can be criticized. Critiques can also 
emerge from the plot of a story. Conflict is an essential feature of many 
plots.* Thus, a focus on various conflicts within an article (e.g. among 
researchers or between researchers and civil society) can serve to call sci- 
entific findings into question. Additionally, a narrative within an article 
can convey a moral message since evaluations also are vital features of 
narratives.°® Including cues for a bad ending can be a strategy for ques- 
tioning an area of research and its evidence in general. More generally, 
narrativization can be used in various ways to indirectly criticize science 
and question evidence. 

Despite many language conventions in daily reporting for appropri- 
ate wording, journalists enjoy remarkable freedom in choosing their 
very own words to describe a particular situation or scientific result. 
Language can underline and deepen certain stereotypes and conflicts. 
And the particular choice of words can either create a narrative world 
or deconstruct it. At the same time, language is very domain-specific: 
Human interest topics, for example, are usually described with other, 
more emotive words than economic news. And, in science coverage, 
plain, prosaic language is predominant, which serves to convey the 
rationality of the field.*? If wording typical of other domains (e.g. human 
interest, religion, esotericism) is used for science coverage, readers may 
build mental associations between the non-scientific domain with the 
research presented. The use of the incongruous language can also be a 
strategy to elicit doubts about the correctness of the presented scientific 
conclusions. 

This brief overview of key journalistic strategies for criticizing sci- 
ence and questioning the evidence for scientific findings leads us to our 
research questions: 


1 What types of personalization, negative stereotyping and conflict 
depictions can be identified in articles on genomic research? 

2 What references to archetypical narratives are made and what kind 
of moral messages are suggested? 

3 And what language and wording is used that is not common in the 
domain of science? 

4 How are these textual strategies applied in the coverage of genomic 
research? 


Evidencing Practices in Media Coverage of Genomic Research 


The following hermeneutic analysis is part of a larger project that ana- 
lyzes evidencing practices in reports on genomic research.* The sample 
of the content analysis consisted of 1,023 articles on genomic research 
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published by German print media and included national quality news- 
papers (Frankfurter Allgemeine Zeitung, Siiddeutsche Zeitung, TAZ), 
regional newspapers (Hamburger Abendblatt, Niirnberger Nachrichten, 
Mitteldeutsche Zeitung), tabloids (Bild, Express, Berliner Kurier) as 
well as weekly news magazines (Der Spiegel, Die Zeit, Focus). A ran- 
dom sample with representative layers for each medium and each year 
was compiled and articles from the year 2000 to 2018 were included. As 
the main focus of this study was to investigate evidencing practices, only 
articles that contained a scientific finding were included. 

To briefly summarize the most prominent result, one of our main 
insights was that scientific findings are usually evidenced by more than 
one journalistic evidencing practice. Explanations of data and methods, 
references to authorities and finally narrative elements are often used 
together to underline the validity of a scientific finding. Additionally, 
these three practices are usually used to support, not to question, the 
evidence of the findings. Notably, counter-narratives are rare: Among 
the 1,023 articles analyzed, roughly half (n = 447) the articles used 
narratives to illustrate the evidence of a finding. However, among these 
447 articles, only 27 used a narrative to question and criticize scientific 
findings, which is less than three percent of all analyzed articles (or six 
percent of articles applying narrative elements). Consequently, the vast 
majority of narratives presents findings and evidencing processes in a 
neutral or supportive way. Focusing on second level evidencing critique, 
these 27 articles containing narratives that argue against scientific evi- 
dencing practices represent the basis of the present hermeneutic analysis. 
Given the sampling strategy of the content analysis, the compilation of 
the resulting 27 articles is systematic and different from selection pro- 
cedures typically used in case studies. Nevertheless, some cases (like 
Monsanto) show up in our material because their practices are repeat- 
edly questioned in counter-narratives. As our hermeneutic analysis will 
show, textual evidencing critique might be a comparatively rare, but, 
when used, strong rhetorical strategy in science journalism. As soon as a 
counter-narrative is employed to question scientific evidence, the possi- 
ble textual strategies are used intensively, as our analysis demonstrates. 


In-Depth Analysis of Narrative Strategies to Question Evidence 
and Criticize Science 


Personalization 


Research on personalization has a long tradition in the field of com- 
munication. It can be defined as an editing process transforming social 
reality into media reality by condensing complex (research) processes 
into a few actions and decisions by a single person.*! A character, 
mostly a scientist, and his or her experiences, motives and emotions 
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are vividly described, which allows for a better understanding of the 
protagonist’s point of view. Our analysis showed the dominance of 
two characters that are repeatedly depicted in the counter-narratives 
on genomic research: The mad scientist and the ruthless company. 
Although a company cannot be directly equated with a person, it can 
be depicted as a unit that acts and that has intentions and both can be 
judged for their morality. 

In the articles analyzed, it is especially companies dealing with genetic 
sequencing or genetically modified plants that are criticized. These com- 
panies appear to act like human beings — and they are endowed with 
human attributes. According to many articles, the companies concerned 
seek to gain financially from the new findings — no matter the costs 
and consequences. Greed drives them, and Monsanto in particular is 
described as a ruthless, corrupt and manipulative liar. The news mag- 
azine Der Spiegel, for example, states with reference to Monsanto: “A 
global industry is trying everything to make the world dependent on 
genetically modified plants”,*? and the quality newspaper Süddeutsche 
Zeitung summarizes simply: “Monsanto is evil”.# 

It is no surprise that ruthless companies and mad scientists dominate 
counter-narratives. In their role as protagonists, they act, they fight and 
they have dubious intentions — which makes it easy for journalists to 
create a highly personalized depiction. In general, active perpetrators 
are more suitable characters for highly narrative news stories than pas- 
sive victims. However, in some cases, the victims’ stories are also told: 
Apart from farmers harmed by genetically modified plants, animals, 
especially cloned animals, are victims. They are exploited as laboratory 
animals, suffer and die early. One example is Dolly, the cloned sheep. 
Like Monsanto, Dolly is not a person. The description of her fate in the 
newspaper Hamburger Abendblatt is nevertheless touching, especially if 
the reader takes the perspective of a human being and makes the com- 
mon idea of “a good life” the yardstick for judging Dolly’s life: “Dolly 
lived a mere 6 years ..., never knew what the sun looked like and never 
tasted grass. For security reasons, the cloned sheep lived in a heavily 
guarded concrete block, where she munched pills containing concen- 
trated food”.** 


Stereotyping 


Personalization can be regarded as a precondition for stereotyping, which 
we discuss with regard to the character type of the mad scientist. The 
importance and ambivalence of stereotypes in media coverage - as help- 
ful organizing structures that reduce complexity as well as bundles of 
attributes that might be used to discriminate against particular groups of 
people — was already outlined a century ago by Walter Lippman in Public 
Opinion.* Nevertheless, content analyses dedicated to stereotypes of 
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scientists in media coverage are rare. With reference to fiction, Matthew 
C. Nisbet and Anthony Dudo identify four characters: (1) The sinister, 
mad scientist; (2) The powerless pawn; (3) The anti-social geek; and 
(4) The action hero.** Rosalynn D. Haynes added two more characters: 
(5) The stupid virtuoso and (6) The scientist as idealist.“ While negative 
character depictions were prevalent in the past, Haynes points out that 
depictions of the mad scientist are becoming less common - at least in 
the realm of fiction.*8 Likewise, Dudo et al. conclude that scientists are 
“cast in good or mixed roles, rather than as the “evil scientist’”.*” 

Regarding the 27 articles in our sample, one negative stereotype is 
dominant, namely that of the mad scientist.’ However, media coverage 
on genomics characterizes the mad scientist type as less sinister but more 
obsessed with scientific work. The scientist appears as a maniac imper- 
vious to moderating influences. One example is the characterization of 
George Church, known for his work on genomic sequencing: 


George Church, molecular geneticist at Harvard University [...] is 
known as someone who considers very few ideas too crazy to try out 
himself. He and a few of his coworkers have been trying for some 
years to revive the mammoth [...] to what end? Is de-extinction just 
one of those researchers running wild ideas? Stuart Pimm is even 
more explicit: ‘De-Extinction is nothing but a way for people who 
otherwise have no clue about how to solve the problems of the world 
to get attention’.°! 


Madness combined with craving for attention is quite often attributed 
to scientists. And in the quotation above from the quality newspaper 
Stiddeutsche Zeitung, another pattern of criticism becomes obvious: In 
conveying criticism or negative stereotyping, another scientist is quoted, 
which allows journalists to hide their views behind quotes and to keep 
the appearance of journalistic objectivity. 

The stereotype of the mad scientist has many facets, and it is frequently 
gendered.” In our sample, an obviously gendered sub-stereotype of the 
mad scientist is the image of the grumpy old man who is unteachable and 
stubborn. An example is Len Hayflick, known for criticizing anti-aging 
medicine. The way his looks and mode of expression are described cha- 
racterizes him as a grumpy old man: 


Len Hayflick’s tone becomes ominous. He turns all the energy that 
he would like to expend stamping his feet into a low rumble. He 
was, in fact, only asked whether he could help non-geneticists to 
prolong people’s lives. ‘Genes have absolutely nothing to do with 
aging,’ barks the grand old man of aging research. And his eyebrows 
are so bushy that they briefly protrude from behind the thick rims 
of his large glasses.’ 


312 Susanne Kinnebrock and Helena Bilandzic 


In stark contrast to these grumpy old men, who decorate quite a few 
articles critical of genomic research, is a young female scientist who 
extended the life of threadworms genetically. 


The young woman breeds worms. Tiny roundworms [...] that wrig- 
gle harmlessly in the test tube but look like monsters with huge gul- 
lets when you look at them under a microscope. ‘I like this face’, 
gushes the researcher, showing a close-up of one of her protégés: 
‘Isn’t it lovely?’54 


This example from Stiddeutsche Zeitung (like quite a few others) indi- 
cates that enthusiasm paired with detachment from common points 
of view seems to be particularly typical of female researchers. While 
the sub-stereotype of the grumpy old man appears to be reserved for 
male scientists, the sub-stereotype of the unworldly enthusiast is mainly 
applied to female scientists. This is not surprising as unworldliness is 
also part of the traditional female stereotype’ as well as of scientist 
stereotypes in general.56 

Another sub-stereotype of the mad scientist is the angry brawler. 
The weekly newspaper Die Zeit presents Craig Venter, a competitor in 
the Human Genome Project, as an “evil and angry underdog of the gene 
scene”.5 Competition between different scientific projects is reduced to 
negative emotions and quarrelsomeness as characteristic of the scien- 
tists involved. To underline how angry these competitors are, emotive 
expressions are used. According to conventions of journalistic writing, 
quotations are usually introduced with neutral formulations such as 
“researcher x says” or “researcher y comments”. But especially in the 
context of the Human Genome Project, the scientists “rant”, “mock”, 
“boast”, “scoff” and “badmouth”.5* Die Zeit concludes: 


In short, the matadors of the gene scene are boiling - partly their 
soup, partly with rage. “There's too much vanity involved,’ says 
Friedrich von Bohlen, head of the Heidelberg-based bioinformatics 
company Lion Bioscience. ‘Prima donnas of the worst kind’ are at 
work there. But if you take a closer look, you’ll see that there’s a bit 
more to the wrangling than hypertrophied egos. It’s about merit, but 
also about business and, in the end, even about science.°? 


In this quotation, another facet of the mad scientist is mentioned: The 
mad scientist can be quite a peacock. Hubris and vanity are typical of 
the peacock sub-stereotype of the mad scientist. These attributes are 
often used in counter-narratives about genomic research and are usu- 
ally applied to male scientists, not female ones. It is remarkable that 
the peacocks are unmasked in the articles - usually by colleagues who 
are presented as honest scientists and reflective thinkers. The strategy 
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behind this negative stereotyping is to depict a person in a poor light 
and hence to question his (rarely her) findings. Thus, it is a roundabout, 
but nevertheless an effective strategy for criticizing evidence. Since we do 
not trust braggarts or villains in our daily lives, there are few reasons to 
trust the findings of a peacock scientist. 

The stereotype of the mad scientist deriving from fiction often includes 
characteristics like sinisterness and power-hunger.% Within our sample, 
however, the role of the sinister villain was not assigned to scientists. Instead, 
it was exclusively reserved for companies in the field of genomics. According 
to the counter-narratives on genomics we analyzed, the most obvious villain 
is Monsanto, which is described as a ruthless and greedy company: 


The peoples of the world rarely agree. But when they look at this 
company, everyone yells: Monsanto is evil. [...] The new group has 
control over what humanity eats and what penetrates the earth. It 
is this power that scares many people. They feel that power is in the 
wrong hands with Monsanto. The rise of the group was rapid. And 
as with almost every rapid ascent, there have been sacrificial lambs 
and skeletons in the closet.®! 


After this introduction, the article from the Siiddeutsche Zeitung relates 
the history of Monsanto, focusing on the trail of devastation the com- 
pany has left. Among other things, the article mentions pollution in the 
US village of Monsanto, where the company was founded, the produc- 
tion of glyphosate and how cancer cases were ignored, Monsanto’s rise 
to a monopolist that blocks competitors and dictates prices, the pro- 
duction of the herbicide Agent Orange during the Vietnam War and 
finally Monsanto’s sinister lobbying practices at institutions of the EU 
in Brussels. The article clearly suggests only one conclusion: Monsanto 
is wicked to the core. 


Excursus Normative and Cultural Foundations 
of Negative Stereotyping 


It is remarkable that deeply negative moral attributes are used to char- 
acterize scientists and companies in the field of genomic research. As 
mentioned before, less than three percent of all articles in a represent- 
ative sample used a narrative to question or criticize the evidence of a 
scientific finding. It seems that, in general, criticizing evidence with a 
narrative rarely happens in media coverage of genomic research. In the 
few cases in which an article presents criticism incorporated in a story, 
however, very rich stories have been created. That means, for exam- 
ple, that the characters were given clear attributes, and the events were 
clearly evaluated. Both is surprising when considering that, thanks to the 
ideal of objectivity, (science) journalism usually tends to avoid too much 


314 Susanne Kinnebrock and Helena Bilandzic 


attribution and evaluation. The intensity of the attribution results 
from the fact that highly moralizing attributes are used in the descrip- 
tion (and stereotyping) of scientists. Many of these negative attributes 
are deeply rooted in Christian culture, especially when they refer to the 
seven deadly sins (sloth, lust, anger, pride, envy, gluttony and greed). 
Stanford Lyman has analyzed these sins as moral laws, which were his- 
torically used in many cultures (not only the Christian) to describe the 
evil and still affect societies all over the world.“ Similar to myths or the 
holy books (be it the Bible, the Koran, the Torah or similar sacred texts), 
the seven deadly sins can be used to quickly classify behavior, or more 
precisely, to brand it as evil. Given the fact that journalism has to be 
understood by and resonate with lay audiences, it is not surprising that 
a common and unambiguous reference system based on the seven deadly 
sins is used to mark science and scientists as evil — which is, of course, a 
very harsh criticism. 

The seven deadly sins and some of the negative attributes conferred 
to scientists in the articles analyzed coincide to a remarkable extent. 
The stereotypical mad scientist is a glutton for (scientific) work, but at 
the same time indifferent to real life and social concerns. Hence, lack 
of moderation as well as unworldliness is associated with gluttony.%+ 
Consequently, the love for roundworms can be read as both unworld- 
liness and indifference to real life, which are linked to gluttony. The 
stereotypical grumpy old man shows anger. Angry brawlers are not only 
angry, but they are also envious, whereby envy as a deadly sin also encom- 
passes jealousy and malevolence.® A peacock is full of pride and vain- 
glory. And, finally, the ruthless company is definitely characterized by 
greed. Without overusing the seven deadly sins, a very important pattern 
of criticizing scientists and thereby science and scientific evidence has 
become obvious: Coverage of genomic research points toward the moral 
deficits of some scientists and companies. Stereotyping takes place along 
a dimension of deeply moral attribution. 


Conflict 


The counter-narratives we analyzed were full of conflicts. And the 
pattern just described for stereotyping - the reference to deeply moral 
categories — also becomes visible when we consider the whole story 
rather than a single character. The articles often tell the story of a fight 
between good and evil. The lines of conflict primarily lie between the 
evil and money-grubbing genetic engineering companies and their oppo- 
nents, who are mostly honest organic farmers, eco-activists or upright, 
research-oriented scientists. Additionally, conflicts arise between scien- 
tists themselves. Good and reflective scientists, who respect the limits of 
what is ethical or feasible, struggle with mad scientists who do not care 
about limits and consequences. 
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The conflicts are underlined by two rhetorical strategies: Scandalizing 
and ridiculing. Scandalizing is a well-known strategy in journalism. The 
roles (victim or perpetrator) are clearly assigned. The perpetrator is pub- 
licly accused of violating a norm, the event is explicitly called a scandal 
and indignation is articulated. Since trust in a scandalized perpetrator 
is compromised, scandalizing scientists can be used as a strategy appar- 
ently to question the researcher as a person, but actually denigrating 
their research and evidencing practices. Scandalizing, therefore, can be 
regarded as a subtle or indirect form of evidence critique. 

Another way of sowing doubts about science and evidence is ridiculing 
scientists, their findings or even a whole research field. Some counter- 
narratives in the articles analyzed were full of irony and mockery. 
Genetic sequencing and its results are described by the weekly newspa- 
per Die Zeit in the following way: 


Genome experts want only to assign about 35,000 genes to humans. 
And once again, this stirs controversy. Although everyone was tre- 
mendously excited about it, the outcome is somewhat unwelcome. 
Some bemoan the third narcissistic affront to humankind by sci- 
ence. First we were downgraded to a product of evolution along 
with monkeys and lice (Darwin did not dare claim this, but it is 
nevertheless the case), then we were declared to be the oppressed of 
the subconscious (Freud did in fact claim this, but it is nonsense), 
and now this: A threadworm of just 959 cells manages to have 
19,098 genes, and humans with their 100 trillion cells have only a 
third more.°’ 


Myths and Master Plots 


Master plots contain an evaluative and moral dimension that frame 
media coverage and guide its interpretation.s The counter-narra- 
tives investigated in this analysis feature a master plot of failure. On a 
micro-level, single events of failure — a failed experiment, a big error or 
the death of a cloned creature - are widely reported. On a macro-level, the 
master plot and the evaluation of the narrative suggest the futility of the 
endeavor or the inevitably bad ending. For example, the stories empha- 
size that nature will revenge itself for human interventions, hubris will 
be punished and interference with the divine order will lead to disaster. 
To underline these messages, explicit references are made to well-known 
myths such as the Frankenstein myth, which stands for a monstrous cre- 
ation as a consequence of a scientist’s arrogance and hubris in seeking to 
be the creator of life.“ 

In sum, the failure master plot either emphasizes that the scientists 
fail to produce evidence, or it frames the whole research enterprise as 
extremely negative. As a result, the articles cast doubt on the evidence 
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of the research presented. And the recurring moral message is “Keep 
the end in mind!” — which is both the headline from the newspaper 
Frankfurter Allgemeine Zeitung and a biblical phrase.” The reference to 
the divine order leads to the last of the five strategies of science criticism. 
The use of language that is typical of another domain - for example, 
religion or esotericism. 


Language 


Just as the name Frankenstein evokes ideas of the myth associated 
with it, words from domains other than science can be used to asso- 
ciate science with fields that, at first sight, do not have much in com- 
mon with science and its evidencing practices. In the counter-narratives 
we analyzed, we were confronted with many words coming from the 
fields of fortune telling (“oracle”, “crystal ball”, “fortune teller”), magic 
(“wizard”, “magic words”), science fiction (“chimeras”, “mixed crea- 
tures”) and dubious quackery (“promises of healing”, “truth serum”, 
“wishful thinking”). And it is remarkable that these words are not only 
used occasionally; they pervade our analyzed counter-narratives. They 
suggest that the respective article deals with an esoteric or fictional plot, 
not with science. And this strategy, placing genomic research and its 
evidencing practices in completely science-free domains, can be regarded 
as an attempt to cast doubt on the correctness of the presented scientific 
findings and conclusions. 

In the same manner, references to religious language and biblical say- 
ings are used and create religious allusions: “Their magic word is stem 
cells. Whoever can breed and train these all-healing cells like the shep- 
herd trains his dogs, the lame and sick will make a pilgrimage to the 
Holy Land like the pious used to do”.”! Sentences like this, which seem 
strange when readers are expecting solid journalistic prose, re-emerge 
frequently. Biblical expressions are also used extensively. Scientists are 
referred to as “creator” or even “god”; “satan” or the “devil” comes 
into play and leads to “temptation”; scientific communities are called 
“parish” or “gene church”; scientific controversies “wars of faith” and 
scientific findings “promises of god”. These are only a few examples 
which give the impression that religious phenomena are being described 
in the articles, not science and its evidencing practices. 

Finally, antiquated language (“zum gleichen Behufe” - for the same 
purpose, “Ein Tor, wer glaubt” — a fool who thinks that) is occa- 
sionally used, suggesting time travel to pre-modern, even medieval 
times, in which theology rather than science was the dominant know- 
ledge system and the natural sciences were associated with alchemy 
and the production of gold.” The extensive use of words and phrases 
untypical of journalistic writing is not coincidental. Rather, the use of 
a language that is not appropriate for covering science can be regarded 
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as a strategy to achieve an image transfer from irrational, ideological 
domains to the field of science. And as soon as science is associated with 
such domains, doubts about its findings, conclusions and evidencing 
practices are easily sown. 


Conclusion 


We have presented counter-narratives that question and criticize the sci- 
entific findings and evidencing practices in the news coverage of genomic 
research. In all, these counter-narratives are rare; the vast majority 
of narratives function to support the evidence of findings in genomic 
research. This might not be surprising since our quantitative content 
analysis focused on articles containing an empirical finding from a study. 
When science and its core activity — carrying out studies and producing 
evidence — are reported, it might be easier for journalists to construct 
narrative descriptions of studies than argue against study results and 
their evidence. In the rare case that a narrative is used to undermine 
research, the criticism is usually indirect in the sense that it is not the 
finding as such that is criticized or questioned, but the moral integrity of 
the scientists and companies involved. The criticism is quite sharp and 
attuned to the readers’ everyday experience and life: Counter-narratives 
are stories about evil villains, mad scientists and failure. 

Patterns of prototypical counter-narratives emerge and they have a 
striking resemblance to archetypal myths — notably in a format (sci- 
ence journalism) that is dedicated to conveying hard scientific facts to a 
wider audience. A prototypical counter-narrative follows common steps 
that - in an evil master’s handbook of counter-narratives — might read 


like this: 


a Identify the perpetrators! (personalization) 

b Describe their bad character! (negative stereotyping and its moral 
foundation) 

c Evoke the conflict between the good and the evil! (conflict) 

d Refer to archetypical narratives and suggest that the story will end 
badly! (master plots) 

e Use language from other well-known mystic domains to make 
research and its evidencing practices appear in a dubious and irra- 
tional light! (language) 


At first sight, the elements of these archetypical science stories on 
genomic research might have little to do with scientific evidencing 
processes because of their non-scientific focus on the (bad) character 
of researchers, on recurring human conflicts or stylistic devices like 
language. However, these narrative elements can be used as strategies 
of critique. They create the context in which research and evidencing 
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practices are depicted and therefore can affect lay audience’s percep- 
tions. It has to be remembered that, outside the science system, first level 
evidence practices are mainly perceived through the lens of second level 
evidencing practices — and among these are narratives. 

The emphasis on morality reveals the basic function of counter- 
narratives — to warn against potential dangers and interests of actors that 
are located outside of science itself. Notably, such discourse, borrowed 
from well-known myths and master plots, is much more intelligible and 
familiar to a non-scientific audience than the scientific facts themselves. 
Whether this serves to make audience judgments more nuanced and cri- 
tical, or to shift the focus away from public engagement with science to 
a generalized distrust toward science due to more or less fuzzy moral 
concerns, must be the subject of future research. 
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